Optimising Principle for Non-Equilibrium Phase Transitions and Pattern Formation 

with Results for Heat Convection 
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Spontaneous transitions between non-equilibrium patterns are characterised by hydrodynamic 
calculations of ideal straight roll steady state heat convection. The calculations are tested quanti- 
tatively against existing experimental data. It is shown that at a given Rayleigh number the final 
wave number depends upon whether the initial state was the conducting state, or, in the case of the 
cross roll transition, the wave number of the initial straight roll state. The final wave number does 
not correspond to the maximum or to the minimum heat flux (entropy production or dissipation), 
nor to the maximum sub-system entropy. In all cases the entropy of the total system increases 
monotonically during the spontaneous transition. It is concluded that there does not exist any sin- 
gle time thermodynamic property or variational principle for non-equilibrium systems. It is further 
concluded that the second entropy is the two time variational principle that determines the optimum 
non-equilibrium state or pattern. 



I. INTRODUCTION 

In the case of equilibrium systems, there is a well estab- 
lished variational principle for determining the optimum 
state, namely that the total entropy is a maximum, or, 
equivalently, that the free energy is a minimum. In the 
case of non-equilibrium systems, there is no such gen- 
erally agreed principle, despite much effort and many 
claims. The two most common ideas invoke the rate of 
entropy production, with one school of thought claim- 
ing that it is a maximum, and another school of thought 
claiming that it is a minimum. The postulated ideas are 
mutually contradictory and there is a dearth of experi- 
mental or computational evidence to support either view. 

In what remains of this introduction, and to fore- 
shadow the numerical results for heat convection that 
are the main work of this paper, it is perhaps of histor- 
ical and psychological interest to explore why the rate 
of entropy production continues to be championed as 
a non-equilibrium variational principle despite the ac- 
knowledged lack of predictive success of the approach. 
In the first place there is the implicit assumption that 
their ought to be an optimum non-equilibrium state. To 
question this assumption is not so bizarre as it might 
seem at first sight, as the numerical results obtained in 
this paper will show. The reason for uncritically assum- 
ing the existence of a non-equilibrium variation princi- 
ple probably lies in the observation that in a given non- 
equilibrium system there are often quite distinct states 
or patterns that spontaneously occur, often reproducibly 
influenced by some control parameter. For example, in 
heat flow, there is the critical Rayleigh number at which 
the conduction-convection transition occurs, and for con- 
vection, there appear distinct steady state patterns (ideal 
straight rolls, hexagonal cells) of particular wave num- 
bers, depending upon the boundary conditions, and other 
sometimes unidentified influences. The patterns that 
form in non-equilibrium systems can be quite spectac- 
ular, and it is natural to assume that the one selected by 
the system in a given case is the result of some general 



thermodynamic principle. 

This idea that there must exist a variational princi- 
ple for non-equilibrium systems is also motivated by the 
success of the Second Law of Thermodynamics for equi- 
librium systems. The principle that the optimum equi- 
librium state is the state of maximum entropy has been 
demonstrably successful in accounting for the selection 
of competing equilibrium states. One can see how this 
might motivate many to think that there ought to ex- 
ist an analogous variational principle for non-equilibrium 
systems. From this many workers simply extrapolate the 
Second Law of (Equilibrium) Thermodynamics to assert 
that, since in the time- independent case entropy is a max- 
imum, in the time-dependent case it is the rate of pro- 
duction of entropy that must be a maximum. Whereas 
the Second Law of (Equilibrium) Thermodynamics was 
postulated by Clausius after much experimental obser- 
vation and measurement, the principle that the rate of 
entropy production be maximised does not come from 
any observation, calculation, or measurement. What is 
more, Boltzmann's discovery of the molecular basis of 
entropy in terms of the number of configurations in a 
state provided a rational explanation, a physical inter- 
pretation, and mathematical framework for the Second 
Law. This again contrasts with the non-equilibrium case 
where there is a disconnect between the molecular pic- 
ture of entropy and the assertion that the rate of entropy 
production is a maximum. 

The historical origin of the opposite postulate, that 
the rate of entropy production is a minimum, appears to 
predate thermodynamics itself. As discussed by Jaynes 
in his review of the Principle of Minimum Entropy 
Production^ in 1848 Kirchhoff 2 developed certain theo- 
rems for electrical circuits, and showed that the electrical 
currents that flowed could be derived from a Principle of 
the Least Dissipation of Energy. Of course there is no 
question of the mathematical veracity of Kirchoff 's theo- 
rem for electrical circuits, but, as is discussed next, there 
is considerable reason to doubt the thermodynamic in- 
terpretation that they are equivalent to a Principle of 
Least Dissipation of Entropy and that such a principle 
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has general application for non-equilibrium systems. 

In ^TT] that follows this introduction, a detailed histor- 
ical review and mathematical critique of these two con- 
ventional ideas for non-equilibrium systems is given. As 
well, comparison is briefly made with the author's own 
variational principle for non-equilibrium systems, namely 
that the second entropy is maximised. In mill the hy- 
drodynamic equations for convection are given, and in 
mV\ expressions for the total first entropy of convection 
are derived. The computer algorithm is given in SjV] for 
the one dimensional case of ideal straight rolls, and in 
E1VII the two dimensional case of the cross roll transition. 
In ^VIIl the convection calculations are compared with 
experimental measurements for spontaneous transitions, 
and various properties of heat convection are tested. In 
^ Villi general conclusions are drawn from the numerical 
results for the optimising principle that gives the selected 
state of non-equilibrium systems. 



II. CRITIQUE OF NON-EQUILIBRIUM 
VARIATIONAL PRINCIPLES 

In this section three non-equilibrium variational prin- 
ciples, — Minimum Dissipation, Maximum Dissipation, 
and Second Entropy — are presented in their simplest 
forms in order to compare their strengths and weak- 
nesses, and the evidence for and against each one. 



A. Principle of Minimum Dissipation 

1. Kirchhoff's Version 

Onsager,— in his celebrated paper on the reciprocal re- 
lations, gave two different Principles of Minimum Dissi- 
pation. The first is directly related to Kirchhoff's Princi- 
ple of Least Energy Dissipation and is treated here. The 
second is related to the vanishing of fluxes conjugate to 
quiescent variables and is discussed in the following sub- 
section. 

In 1848 Kirchhoff generalised Ohm's law to three di- 
mensions and noted that the current in any region was 
determined by minimising the energy dissipation (Joule 
heating) with respect to the voltage for specified values 
on the surface.— This principle of least energy dissipation 
was derived by Kirchhoff from the fact that in the steady 
state electrical charge could not accumulate at any point. 

For the present purposes, and following Jaynes?i it is 
sufficient to consider two resistors, R\ and R 2 connected 
in parallel with total current J = J\ + J% flowing through 
them. (The total current is equivalent to a potential drop 

energy dissipation or Joule 

heat is 

E = JlR x + JlR 2 = JlR x + [J - J^R.2. (2.1) 
The derivative of this at constant total current (equiva- 



lently, fixed potential drop) is 

be 

— =2J 1 R 1 -2[J-J l ]R 2 , (2.2) 

OJi 

which vanishes when 



This current minimises the energy dissipation and is of 
course just the current that one would obtain directly 
from Ohm's law. 

The Principle of Least Entropy Dissipation appears to 
follow from this by considering the case that the resistors 
are in thermal contact with a reservoir of temperature T, 
so that the rate of production of entropy in the reservoir is 
just S r = E/T. Hence minimising the energy dissipation 
is the same as minimising the entropy dissipation. 

There are two major problems with the extrapolation 
of Kirchhoff's principle of electrical circuits to a general 
principle for non-equilibrium systems. First, the princi- 
ple of least dissipation of energy has nothing to do with 
entropy. To see this simply consider the case that the 
resistors are in contact with two separate reservoirs of 
temperature T\ and T 2 respectively. The currents do not 
change, but the entropy production is no longer a min- 
imum. (The minimum entropy dissipation would occur 
when Ji = R 2 J/T 2 [(R 1 /T 1 ) + (R 2 /T 2 )}, which obviously 
violates Ohm's law.) 

The first problem also signifies a common misun- 
derstanding of non-equilibrium variational principles, 
namely it is often not precisely clear what one is trying 
to achieve by such a principle. In the present problem of 
current flow, Ohm's law already completely specifies the 
current flow for the stated problem. There is no point in 
formulating a variational function for current flow unless 
it has application beyond Ohm's law. More generally, any 
non-equilibrium variational principle has to be explicitly 
formulated as consistent with, but providing something 
beyond, the linear transport laws. This point will be 
further discussed below. 

The second problem with the thermodynamic inter- 
pretation is that only part of the entropy dissipation has 
been considered. The battery or source of electromotive 
force that drives the current also dissipates entropy. If 
the state of non-equilibrium systems were truly deter- 
mined by the entropy dissipation, then surely it is the 
total entropy dissipation that is relevant. 

On this point it is worth mentioning the work of 
Zupanovic et al.^ also based on Kirchhoff's laws, but in 
this case giving a Principle of Maximum Entropy Dissipa- 
tion. The reason that they obtained a maximum rather 
than the more traditional minimum is that they took 
into account the energy supplied by the electromotive 
forces and invoked energy conservation as a constraint 
on the variation of the Joule heat. But their thermody- 
namic conclusion is vitiated for the same reason as just 
discussed, namely that the result comes directly from 
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Ohm's law (and energy conservation) and has nothing to 
do with entropy. If the resistors in the circuit are at dif- 
ferent temperatures, and if the entropy dissipated by the 
batteries and sources of electromotive force is taken into 
account, then the entropy dissipation would no longer be 
maximal. 

Onsager, in the first of his two celebrated papers on 
the reciprocal relationship gives a non-equilibrium vari- 
ational principle, Eq. (6.6) of Ref. 0, which case he says 
has been named the 'Principle of the Least Dissipation 
of Energy'. Onsager says that if the boundary fluxes are 
specified, and if the sub-system is in a steady state, then 
Rayleigh's dissipation function, a quadratic of the fluxes, 
is a minimum. Rayleigh's dissipation function has the 
same appearance as the Joule heat in Kirchhoff's Princi- 
ple of Least Dissipation of Energy. Four criticisms can be 
made of Onsager's proposal, all of which can be made of 
any thermodynamic interpretation of Kirchhoff's Princi- 
ple: First, that Rayleigh's dissipation function does not 
give the actual entropy dissipation for the arbitrary fluxes 
that are explored in the variational procedure. Second, 
that the rate of total entropy production is not accounted 
for. Third, since one can multiply Rayleigh's dissipation 
function by an arbitrary constant, including a negative 
one, and still obtain the same optimum value, the varia- 
tional function cannot be a physical thermodynamic po- 
tential. Fourth, and connected with the third, the varia- 
tional procedure yields nothing beyond the built-in linear 
transport laws, not even the reciprocal relations. 



2. Onsager's Version 

Onsager gives a second form of the Principle of Mini- 
mum Entropy Dissipation (Principle of Least Dissipation, 
for short) in § 6 of Ref. |j, leading up to and following 
his Eq. (6.5). This version of the Principle is said to 
apply to certain non-equilibrium systems when some of 
the fluxes vanish. Identical Principles of Minimum En- 
tropy Dissipation for vanishing fluxes have been invoked 
by Prigogine^ and by de Groot and Mazur<£ 

Onsager claims that this Principle gives rise to the re- 
ciprocal relations (see p. 424 of Ref. [I]). He dwells upon 
the historical antecedents of the Principle (he attributes 
it to Hclmholtz and to Kelvin rather than to Kirchhoff) 
in his acceptance speech for the Nobel prized The claim 
that it is the basis of the reciprocal relations is also made 
by Mazur in his summary of Onsager's achievements^ If 
true, such a result would provide a distinct derivation of 
the reciprocal relations that was independent of the mi- 
croscopic reversibility derivation that Onsager actually 
used, and it would arguably justify regarding this par- 
ticular Principle of Minimum Entropy Dissipation as a 
fundamental thermodynamic principle. This claim will 
now be tested. 

For simplicity consider an isolated system, with x = 
{xi, X2, ■ • • ,x n } being the non-conserved material quan- 
tities of interest. The associated fluxes are J = 



{Ji, J2, ■ ■ ■ , Jn} with Ji = x®/V, the superscript zero 
signifying an isolated system. The conjugate thermody- 
namic forces, X = {Xi,X 2 , . . . , X n }, are the derivatives 
of the entropy, Xi = dS{x)/dxi. For example, the rele- 
vant extensive material variable might be the first energy 
moment, in which case the thermodynamic force is the re- 
ciprocal of the first temperature, which is essentially the 
temperature gradient, and the flux is the energy crossing 
a plane per unit area per unit time. 

The specified structure x, or equivalently force X(x), 
is considered to have arisen as a fluctuation from the 
equilibrium state of the isolated system, and the flux J 
represents the regression of the fluctuation back to the 
equilibrium state. 

It will turn out that the analysis is equivalent to exam- 
ining the coupling between forces and fluxes in the case 
that some of the variables are relevant variables, and oth- 
ers are quiescent variables. Relevant or active variables 
have a specified value of the thermodynamic force (equiv- 
alently the value of the material property), that results 
either from a fluctuation of an isolated system or else 
from exchange with reservoirs. Quiescent or slave vari- 
ables have either zero force (in the instant of the initial 
fluctuation of the active variable for an isolated system) , 
or zero flux, (for a steady state sub-system with the qui- 
escent variables being non-exchangeable with the reser- 
voir). 

For example, in the case of thermodiffusion, one has 
two material properties, namely the moments of energy 
and number. If one wants to concentrate on heat flow, 
then one can still use the two component formalism, but 
treat the number variables as quiescent and set their 
fluxes to zero (and one can calculate the non-zero value 
of the thermodynamic force on the number). Alterna- 
tively, and ultimately equivalently, one can consider a 
single component of energy alone, and never consider ex- 
plicitly the number fluxes or forces. In the full case when 
both are active, the energy and mass fluctuations are 
non-zero, and their fluxes are both non-zero. 

There are two questions: First, do the reciprocal rela- 
tions imply the Principle of Least Dissipation (with re- 
spect to the quiescent fluxes)? Second, does the Principle 
of Least Dissipation imply the reciprocal relations? 

For simplicity consider everything to be uniform in 
space. By definition, the rate of entropy production per 
unit volume of the system is 

S/V = 3-X. (2.4) 

This exact formula holds whether or not the fluxes are 
the optimal ones. This will be called the dissipation. 

The phcnomenological or linear transport laws say that 
the fluxes are proportional to the thermodynamic forces, 

J = ^X. (2.5) 

In this form of the linear transport laws, the n forces are 
regarded as the independent variables. 
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Here Onsager's notation for the fluxes is used rather 
than the present author's. The present author always dis- 
tinguishes between arbitrary fluxes J and optimal fluxes 
J; only the latter obey the linear transport laws. On- 
sager (and most other authors) do not distinguish the 
two explicitly. Because one is carrying out variational 
procedures for arbitrary fluxes, it can be difficult to figure 
out precisely which equations assume the linear transport 
laws and which do not. 

With the linear transport laws in this form with the 
forces as independent variables, the dissipation becomes 
a quadratic form, 



S/V = X ■ AX. 



(2.6) 



Since the Second Law of Thermodynamics mandates that 
the dissipation be positive, this implies that the transport 
matrix must be positive definite. 

The Onsager reciprocal relations says that the trans- 
port matrix is symmetric, 
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(2.7) 



To answer the first question this will be assumed true. To 
answer the second question it will be checked whether or 
not the Principle of Least Dissipation implies this result. 

Now the first m variables will be considered active, 
and the second n — m will be considered quiescent. Use a 
sub-script 1 for the first m variables and 2 for the second 
n — m variables, so that Ji = {J\, J 2 , . . . , J m } and J 2 = 
{ J m +i, Jm+2, ■ ■ ■ , Jn}, and similarly for Xi and X2. The 
transport matrix A similarly breaks into four blocks, and 
the reciprocal relations imply 



4r = ^4 2 = ^-d4 2 = 4V 



(2- 



In block form, the linear transport laws are explicitly 



j x = 4 lXl +4 2 x 2 
j 2 = 4 1 x 1 +4 2 x 2 . 



(2.9) 



Choosing the first m forces and the second n — m fluxes 
as the independent variables, the linear transport laws 
may be rewritten 



Ji 



A -A A' 1 A 
=11 =12=22 =21 



Xi + A A- X J 2 
1 =12=22 z 



x 2 = -4 2 1 4 1 x i+4" 2 lj ^ 



(2.10) 



The rate of entropy production is a quadratic form in 
these independent variables 



S/V = Ji-Xi+J 2 -X 2 

= Xi 



An - 4a4a 4i 



x i + x i-4 2 4 2 lj 2 



~j 2 -4- 1 4i x i + j 2-4 2 1j 2 

Xi ■ 4H Xl + J 2 . A-ij 2 



J 2 



(4 2 1 ) T =i2 ~ 4 2 1 4i 



Xi. 



(2.11) 



Here A^ m ^ = A ±1 — A 12 A 7o A 21 ^ s tne m x m transport 
matrix that would hold if the active components only 
were considered. In this case the linear transport laws 
are Ji = .A^Xi, as will now be shown. 

Now if the reciprocal relations hold, then Eq. (|2. 
implies 



4 2 2 1 ) T =i2 -4 2 1 4r 



(2.12) 



Hence the cross term vanishes and the dissipation be- 
comes 



S/V = Xi -^ (m) Xi 



J2-A-ij 2 . 



(2.13) 



Because the full transport matrix is positive definite, each 
of the two transport matrices that appear here must also 
be positive definite due to the combination of sub-blocks 
from which they are formed. Hence one can see that 
the reciprocal relations imply that the dissipation is min- 
imised by the vanishing of the quiescent fluxes 



dS/V 



dJo 



(2.14) 



In this case, because J2 = 0, the linear transport laws, 
Eq. (|2~T01) . become Ji = ^ (m) Xi, which are those that 
would apply if only the active components were consid- 
ered. 

This result proves that if the reciprocal relations hold, 
then the entropy dissipation is minimised by the vanish- 
ing of the quiescent fluxes. The significance or otherwise 
of this result will be discussed shortly. 

Now to the second question: does minimising the dis- 
sipation with respect to the quiescent fluxes imply the 
reciprocal relations? Differentiating with respect to the 
independent fluxes the form of the dissipation that does 
not assume the reciprocal relations, Eq. (|2.1ip . one ob- 
tains 



dS/V 
dJ 2 



(A~ 1 ) T A T - A-' A 
=22 ; =12 =22 =21 



Xi 



24-^2. (2.15) 



Demanding this vanish at J 2 =0 yields Eq. (|2.12[) , 

(4 2 1 ) T =i2 = 4 2 1 4r 

But this equation does not in general imply the block 
form of the reciprocal relations, Eq. (|2.8p . since the ma- 
trices cannot be separately equated. 

For the case n = 2 and m — 1 these matrices are 
scalars. In this case, and only in this case, the scalar ^22 
cancels both sides and one is left with the scalar equal- 
ity A12 = A21, which is the reciprocal relation for two 
coupled flows. It is to be noted that both Onsager (see 
the discussion following Eq. (6.5) of Ref. 0), and Mazur 
(see the equations and discussion leading to Eq. (7) of 
Ref . 0) , in claiming that the Principle of Least Dissipa- 
tion implies the reciprocal relations, both offer only an 
n = 2, m = 1 example. One cannot deduce the prop- 
erties of the matrix A for general n from the pairwise 
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results obtained for n = 2 without making the additional 
assumption that the individual elements do not depend 
upon the other components of the system, which in any 
case appears to be false. For example, it is not true 
that the Soret coefficient for thermodiffusion does not 
depend on the specific solvent or on the concentrations 
of the other solutes. Whereas the reciprocal relations im- 
ply A^f' = , the extrapolation of the pairwise result 

would require A^ — AJ? ^ , which is not true in general. 

In contrast, the reciprocal relations hold for an arbi- 
trary number of active and quiescent variables; Eq. (|2.8[) 
contains more information than Eq. (I2.12[) . One con- 
cludes that the reciprocal relations are sufficient but not 
necessary to ensure that the dissipation is minimised 
when the quiescent fluxes vanish. The present author 
cannot agree with the claim by Onsager— and by Mazur 9 
that the Principle of Least Dissipation for quiescent 
fluxes implies the reciprocal relations. 

Finally then, what actually is the use of the Princi- 
ple of Minimum Dissipation? Is it really so surprising or 
significant that the entropy dissipation is reduced by set- 
ting some of the fluxes to zero, Eq. (|2.13[) ? Is it even true 
that in the actual physical problem — the regression of a 
fluctuation of an isolated system — the flux of quiescent 
variables vanishes? In fact, at the first instant r = of 
a fluctuation in the active variables, the force and flux 
of the quiescent variables is zero. At some intermediate 
time after that, the quiescent force is non-zero, and so 
the quiescent flux also must have been non-zero leading 
up to that state, and it must be non-zero going forward 
in time as both active and quiescent forces relax back to 
zero. (This is different to the steady state situation for a 
sub-system that can exchange with reservoirs, in which 
case the active and quiescent forces are constant in time, 
and the quiescent flux is zero.) One can conclude that 
whilst the reciprocal relations imply that the dissipation 
is minimised when the quiescent fluxes vanish, in many 
cases in the real world the quiescent fluxes do not van- 
ish and the dissipation is not a minimum with respect to 
them. 

More generally, the Principle of Minimum Dissipation 
does not give either the values of the active fluxes or 
the quiescent forces, since these come from the linear 
transport laws for the given active forces and the zero 
quiescent fluxes, Eq. (|2.9[) . It is difficult to identify any- 
thing of import that is achieved by minimising the dis- 
sipation with respect to the quiescent fluxes, or to see 
how one might erect a full thermodynamic theory for 
non-equilibrium systems on this Principle. 



B. Principle of Maximum Dissipation 

Although most who assert the Principle of Maximum 
Dissipation do so based on nothing more than an anal- 
ogy with the Second Law of Equilibrium Thermodynam- 
ics, Onsager actually attempted a detailed justification. 



Onsager believed that a particular function that he for- 
mulated, the entropy dissipation less Rayleigh's dissipa- 
tion function, was a thermodynamic potential for non- 
equilibrium systems. In fact, he asserted that 'the recip- 
rocal relations. . . can be expressed in terms of a potential, 
and permit the formulation of a variational principle', 
(just prior to Eq. (5.1) of RefQ). 

Onsager, in Eq. (5.3) of Ref. 1, defined what will be 
called here the Rayleigh dissipation function, 

<j)(3) = -J -AT 1 J. (2.16) 

This is written in the present notation, with the con- 
stant a being introduced here in order to make a point 
about the arbitrariness of Onsager's functional; Onsager 
implicitly chooses a — 1. Onsager says that this dissipa- 
tion function was originally introduced by Rayleigh as a 
potential for frictional forces*^ 

As mentioned above, there is a certain ambiguity in 
Onsager's work regarding whether he regards the fluxes 
as arbitrary, as here and in his Eq. (5.3) ^ or whether 
he restricts them to satisfying the linear transport laws, 
which he does in the second expression that he gives for 
the Rayleigh dissipation function, Eq. (5.5)4 

This ambiguity underscores a significant problem with 
Onsager's work, namely that the Rayleigh dissipation 
function is only related to the entropy dissipation (it is 
equal to a/2 times the entropy dissipation) when the 
fluxes are equal to the values given by the linear transport 
laws. For arbitrary fluxes, this function is not directly re- 
lated to the entropy dissipation. Since Onsager is devel- 
oping a variational principle for arbitrary fluxes, which he 
believes has the physical meaning of the non-equilibrium 
thermodynamic potential, it is crucial to appreciate that 
Rayleigh's dissipation function does not have the physical 
interpretation given it by Onsager. 

Onsager, in Eq. (5.9) of Ref. |4|, shows that the rate of 
total entropy production per unit volume, (here assuming 
spatial homogeneity), is 

S/V = J • X, 

which was given above as Eq. (|2.4[) . Although Onsager 
derived this for the general case of a sub-system and a 
reservoir, it also holds for the total isolated system con- 
sidered here. 

Onsager gives his variational functional as 

o(jix) = ^--m 

= oJ ■ X - | J ■ AT 1 J, (2.17) 

where again the a has been inserted here, since Onsager 
actually took a — 1. It was of course necessary for On- 
sager to subtract the quadratic dissipation function 4>(3) 
from the actual entropy dissipation because S is linear 
in the flux and does not have an extremum. (A com- 
mon feature of all the variational principles is that they 
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must contain a term quadratic in the fluxes and a term 
linear in the fluxes, with the latter being proportional to 
the entropy dissipation.) Onsager says that his function 
C(J|X) is to be maximised over the fluxes for specified 
forces, (since the dissipation must be positive, A must 
be positive definite, and the extremum has to be a max- 
imum) . 

Onsager offers no particular physical justification for 
this choice of functional other than that it is optimised 
by the linear transport laws, 



J = AX. 



(2.18) 



The maximum value of the variational functional is 



O(J|X)=0(J) = -J-X. 



(2.19) 



The right hand side is just a/2 times the rate of entropy 
dissipation in the optimal state. 

The linear transport laws emerge irrespective of the 
value of a. Onsager's analysis is equivalent to choos- 
ing a value of a = 1. The physical basis for implicitly 
choosing a = 1 is unstated by Onsager, but the conse- 
quence is that it is the entropy dissipation itself (less the 
Rayleigh dissipation function) that is maximised rather 
than some multiple thereof. As such, this has the appear- 
ance of being a physical quantity. Of course as a matter 
of logic Onsager could equally have chosen a — —1, in 
which case he would have had a Principle of Minimum 
Dissipation. Perhaps Onsager, like other proponents of 
the Principle of Maximum Dissipation, implicitly chose 
a = 1 by analogy with the Second Law of Equilibrium 
Thermodynamics. 

Onsager's variational function upon which he based 
his Principle of Maximum Dissipation will next be com- 
pared with Attard's second entropy function ; 11 ' 12 which 
amongst other things gives a particular value and physi- 
cal interpretation to the quantity a. The point that can 
be made here is the arbitrary nature of Onsager's func- 
tional. As such it cannot be the non-equilibrium ther- 
modynamic potential, because any ambiguity in such a 
potential would have measurable physical consequences. 
Onsager's implicit choice, a = 1, corresponds to max- 
imising the entropy dissipation, is no more justified than 
the choice a = — 1, which would correspond to minimis- 
ing the entropy dissipation; both choices are in fact incor- 
rect, as will now be shown. Finally, despite the assertion 
made by Onsager and quoted above, no evidence is of- 
fered by him that the variational function is necessary 
for the reciprocal relations. (By design, the variational 
functional is sufficient to yield the linear transport laws.) 

A variety of variational principles can be constructed 
from different combinations of the quadratic dissipation 
functions S(J,X) = J X, <j>{3) = J • A _1 J/2, and 
■0(X) = X • AX/2. These have featured in a num- 
ber of postulated thermodynamic potentials for non- 
equilibrium systems in the literature, as has been re- 
viewed by the present author By design these always 
give the linear transport laws as their optimum state, but 



they are subject to the same criticisms as have been made 
above: In general the functions have no physical meaning 
away from the optimum state, and so they don't provide 
the actual driving force toward the optimum state. Also, 
there is no physical basis for extremising the dissipation, 
and therefore there is no fundamental thermodynamic 
justification for the postulated functions. 



C. The Second Entropy 

The present author gave a variational principle for 
the fluxes and structure based upon the so-called sec- 
ond entropy, which can also be called the transition en- 
tropy, or the two-time entropy. The full theory is given 
elsewherei 11 ' 12 Here it suffices to say that the theory 
treats as the fundamental non-equilibrium object the 
transition between two states in a specified time inter- 
val, x x'. The flux is essentially defined as the coarse 
derivative, J = [x'-xJ/tV. In fluctuation form, the first 
(or ordinary, or structural) entropy is 



5 (1) (x) = -x-Sx, 
v j 2 = 



(2.20) 



the thermodynamic force is X = 5x, and the second 
entropy is, (in the present notation), 



S( 2 )(J,x) 



V 



4 



-J X 



X • AX 



S«(x) 



(2.21) 



4 = V 

This holds for arbitrary fluxes that do not necessarily 
obey the linear transport laws. The all-important coeffi- 
cient of the cross term, which makes it half the dissipa- 
tion, as well as the final two terms, which are constant 
with respect to the fluxes and which are therefore of lesser 
importance, come from a small time expansion and the 
so-called reduction condition, 



S< 2 >(j,x) = S«(x). 



(2.22) 



This is formally exact and is simply a statement of Boltz- 
mann's molecular definition of entropy 11 ' 12 

It is evident that the second entropy is maximised with 
respect to the fluxes when the linear transport laws are 
satisfied, 



dS^(3,x) 



83 



= o & J = ax, 



(2.23) 



j=j 



going forward in time, r > 0. Hence maximising the sec- 
ond entropy is equivalent to the linear transport laws. 
But the second entropy itself is valid for non-optimal 
fluxes that do not satisfy the linear transport laws. 

From the nature of the derivation of the second en- 
tropy, specifically that the fluctuations in an equilibrium 
system are time symmetric, the coefficient matrix is sym- 
metric, A = Aj~ (at least for variables of pure time par- 
ity). Hence the second entropy implies the Onsager re- 
ciprocal relations. 
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1. Comparison with Onsager's First Function 

Comparing Onsager's variational function Eq. (|2.17[) 
with Attard's second entropy, Eq. (|2.21| going forward 
in time, r > 0, one sees that apart from the immaterial 
terms that are constant with respect to the fluxes, the 
two are proportional to each other 

C(J|X) = — 5 (2) (J, X) + const. (2.24) 

T 

This says that the physically correct value is a = r/2 (at 
least going forward in time). As mentioned above, any 
variational principle for the non-equilibrium thermody- 
namic potential must be a quadratic in the fluxes, and 
so the only choice in the functional form is for the three 
coefficients of the quadratic equation. Since only differ- 
ences in potentials have physical meaning, any constant 
term is immaterial, and so there are two coefficients to 
determine. One coefficient is fixed by demanding that 
the optimum flux satisfy the linear transport laws. The 
remaining degree of freedom was fixed by Onsager by 
demanding that it be the rate of entropy dissipation it- 
self that be maximised, a — 1. There is no physical 
requirement for this. In Attard's second entropy case, 
this remaining degree of freedom was instead fixed by 
the formally exact requirement that the second entropy 
reduce to the first entropy in the optimum state. (The 
analysis was actually a little more complicated than this 
in that it required a small time expansion of the fluctu- 
ation matrices, equating the coefficients term by term in 
the reduction condition.) 11 ' 12 

As mentioned above, the arbitrary nature of the jus- 
tification for Onsager's functional actually has physical 
consequences that preclude it from being a proper ther- 
modynamic potential. Onsager's implicit choice of a = I 
means that his function C(J|X) and the second entropy 
5( 2 )(J,X) have different curvatures. If the functionals 
are to represent the non-equilibrium thermodynamic po- 
tential, then their exponential must give the probability 
distribution of the fluxes, and their curvature must give 
the fluctuations in the fluxes. Because the second en- 
tropy is the physical entropy, it gives the probability of 
a fluctuation in fluxes and structure in an equilibrium 
system. The arbitrary choice a = 1 by Onsager yields 
incorrect fluctuations in the fluxes. 



2. Comparison with Onsager's Second Function 

Onsager, in Eq. (5.10) of his second paper on the re- 
ciprocal relations^ gives what he believes is the actual 
thermodynamic potential whose exponential divided by 
Boltzmann's constant gives the probability of a transi- 
tion. It ought to be directly comparable to the second 
entropy, and in the present notation it is 

6(J,x) = S' (1) (x) + 5 (1) (x')- ^ J -^ lj 



= const. + rJ-X-^J-^ 1 J. (2.25) 

Here an expansion to linear order in the time interval 
has been performed. It can be seen that this differs by 
a factor of 2 from the second entropy. In addition it 
does not correctly take into account the irreversibility of 
thermodynamic transitions (i.e. the absolute value of the 
time interval should appear in the final term) . These dis- 
crepancies arise from the lack of physical justification for 
Onsager's postulate that the rate of entropy dissipation 
is maximised. Despite these problems, one can neverthe- 
less observe that this variational function is rather close 
in spirit to the second entropy approach. 



3. Comparison with Onsager's Third Function 

Onsager and Machlup?^ some 20 years after the pa- 
pers just mentioned, gave a further variational principle 
that is based upon an expression almost identical to the 
second entropy expression. In Eq. (4.2), they derive the 
conditional probability for the scalar transition x\ A x 2 
from the Langevin equation. The key assumptions, in the 
present notation, are that the first entropy has fluctua- 
tion form (i.e. S^{x) = Sx 2 /2 and X = Sx), that the 
system is Markovian so that the most likely regression is 
exponential, x 2 — e^ T ^ VAS xi, and that the stochastic pro- 
cess is stationary and Gaussian. The latter assumption 
means that the variance of the random Langevin force is 
fully determined by the entropy and transport constants. 
This supplies the additional condition needed to fully de- 
termine the two non-trivial coefficients for the quadratic 
variational principle and removes the ambiguity of On- 
sager's prior versions of the Principle. 

It is worth mentioning that a full analysis of station- 
ary, Gaussian, Markov processes, which are also called 
Ornstein-Uhlenbeck processes, is given by Keizer in §1.8 
of Ref. 151 Keizer treats the multi-component Langevin 
equation, taking into account the non-commutativity 
of the matrices, and gives the generalised fluctuation- 
dissipation theorem. The generalised Langevin e quat ion 
is treated by the present author in Ch. 10 of Ref. [l2|. 

The second entropy corresponding to the exponent of 
the unconditional probability based on Eq. (4.2)^ is, in 
the present notation, 

= S (1) (*i) + ±S[l- e^ VAS Y X [x 2 - e TVAS x x ] 2 
= S«( a;i )- i ^A- 1 [l + 0(r)] 

x [x 2 -X!- tVASxi + 0{t 2 )] 2 
= S {1 \ Xl ) - ^-A- 1 [J - AXrf + 0{t 2 ). (2.26) 

For r > 0, this may be seen to equal the expression for 
the second entropy given above, Eq. (|2.21l) . (For r < 
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this does not correctly account for the irreversibility of 
the trajectory. Also, whereas Onsager assumed Markov 
behavior, Eq. (|2.21|) has been shown to hold as well for 
non-Markov systems. See §2.3 and §2.4.6 of Ref. 12h 
Onsager and Machlup, in Eq. (4.19) of Ref. [l4, recast 

Sq^ as a variational principle for the time integral of the 
so-called thermodynamic Lagrangian, which involves the 
dissipation functions <fr, ip, and S, 



3 (x 2 \xi,t) = — 



dt &(x(t))+^(X(x(t))) 



S(x(t),X(x(t)))]} 



(2.27) 



Minimisation of the integral with respect to the path con- 
strained to fixed values at specified nodes (in this case X\ 

( 2) 

and X2 at t\ and t% = tx + r) yields S l A (x2, xi\t). (It 
is possible to specify values at more than two nodes.) 
This variational functional is rather common in the field 
of stochastic differential equations and there are a num- 
ber of thermodynamic Lagrangians that are based upon 
itji^r— In particular, the integrand is the negative of 
the variational principle used by Gyarmati , 23 ! 24 and it 
is equal to the thermodynamic Lagrangian given by 
Lavenda, Eq. (1.17)i2£ The same criticism may be made 
of it as of the other variational functions: it has no phys- 
ical meaning in the constrained state, and it is but one 
of an infinite family of variational functionals that could 
be constructed to yield the steady state, but which are 
physically meaningless more generally. 

In any case, it is not entirely clear why one would want 
to carry out this variational procedure since one already 
has an explicit expression for both the optimum path 
between the nodal values and the path entropy for the 
nodal values. Perhaps Onsager never fully appreciated 
the second entropy, and instead continued to search for 
an alternative thermodynamic variational principle for 
non-equilibrium systems based upon the rate of entropy 
dissipation. From the point of view of the present au- 
thor, the thermodynamic principle for non-equilibrium 
systems is given by the second entropy for transitions, 
and this is not directly connected to the rate of entropy 
dissipation. 



4- The Point of the Second Entropy 

What is the use of the second entropy? Does it give 
anything beyond the already known reciprocal relations 
and linear transport laws? One can identify two ad- 
ditional results of significance. First, and conceptu- 
ally, it provides a rigorous variational principle for non- 
equilibrium thermodynamics, and one that is unique on 
physical grounds. This is the analogue of the Second 
Law of Equilibrium Thermodynamics. Second, and prac- 
tically, it provides the correct formula for the probability 
of fluctuations in the fluxes. These are not given by the 
linear transport laws, and it is this property that makes 
it the correct non-equilibrium thermodynamic potential. 



Beyond these specific consequences, there is more neb- 
ulous but possibly more far-reaching outcome of the sec- 
ond entropy approach: it focusses thinking about non- 
equilibrium systems on the transitions between states 
rather than on the states themselves. The states may 
be regarded as the objects of equilibrium thermodynam- 
ics and, in contrast, it is the transitions that are the stuff 
of non-equilibrium thermodynamics. It is this change 
in mind set that is crucial to providing the insight as 
to why the Principle of Least Dissipation (or Principle 
of Maximum Dissipation) cannot provide the basis for 
non-equilibrium thermodynamics. And, as will be shown 
explicitly in this paper, it provides a conceptual basis 
for interpreting not only the specific computational re- 
sults obtained here for heat convection, but also for un- 
derstanding in general non-equilibrium phase transitions 
and pattern formation in non-equilibrium systems. 



III. HYDRODYNAMIC EQUATIONS OF 
CONVECTION 

A. Boussinesq Approximation 

The Boussinesq approximation is generally invoked for 
hydrodynamic calculations of convective heat flowj 25 i 26 
In this the compressibility is set to zero, xt — 0, and 
the thermal expansivity is neglected everywhere except 
in the buoyancy force. With these the density equation 
reduces to the vanishing of the divergence of the velocity 
field, 



V-v(r,t) =0. 



(3.28) 



This means that the most likely value of the scalar part 
of the viscous pressure tensor vanishes, 7f = 0. 
The gravitational potential density is 

n(r,t)i>(r,t) = {n 0Q - cm opt ot (r, t) - T m ]}mgz. 

(3.29) 

Here a is the thermal expansivity, g is the acceleration 
due to gravity, and m is the molecular mass. The sub- 
script tot signifies the total temperature, T to t =To + T, 
where To is the temperature in conduction, and T is con- 
vective perturbation. The subscript 00 denotes the refer- 
ence value at the mid-point of the sub-system, and every- 
thing will be expanded to linear order in the difference 
from this reference point. Inserting this in the Navier- 
Stokes equation and neglecting the term quadratic in the 
velocity yields 



mn 00 - 



<9v(r,t) 
dt 



{n Q0 - an 00 [T tot (r, t) - T 00 }} mgi 
-V Pto t(M)+?7V 2 v(r,i), (3.30) 



where r\ is the shear viscosity. 

Neglecting the viscous dissipation, which is quadratic 
in the velocity, and also the thermal expansivity, and 
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using the most likely heat flux, the energy equation be- 
comes 

Cp dTtot(r,t) +Cpv(M) , VTtQt(M) = AV 2 T tot (r,t), 

(3.31) 

where A is the thermal conductivity. The coupling of 
velocity and temperature represents a non-linear term. 
These three partial differential equations constitute the 
Boussinesq approximation that is to be solved for the 
temperature, pressure, and velocity fields. 



The rate of entropy production per unit sub-system vol- 
ume is 



S T /AL Z 



7° 



1 



1 



AA 2 

± 00 1 ^z 



(3.37) 



This is positive and independent of the sign of the tem- 
perature difference, as it ought to be. 



Convection 



B. Conduction 

The simplest case of slab geometry is treated here, with 
a temperature gradient imposed in the z-direction. The 
convective flow is treated as a perturbation from the con- 
ducting state. In conduction, the velocity field is zero, 
v(r,i) =0. 

The boundaries of the sub-system are located at z = 
±L z /2, and the temperatures of the reservoirs beyond 
the boundaries are T T ±. The temperature difference is 
At = T I+ — T r _. It is assumed that the imposed tem- 
perature gradient, A^/L z , is small and that quadratic 
terms can be neglected. This means that it does not 
matter whether one deals with the difference in temper- 
ature or with the difference in inverse temperature. For 
convection to occur, the lower reservoir must be hotter 
than the upper reservoir, At < 0. 

Since in conduction the velocity vanishes, and the tem- 
perature is steady and a function of z only, the energy 
equation reduces to 



= A 



d 2 T (z) 
dz 2 ' 



(3.32) 



Hence the temperature field is a linear function of z that 
must equal the reservoirs' temperatures at the bound- 
aries, 

T (z) = Too + ^-z, \z\ < L z /2, (3.33) 

with the mid-point temperature being Too = Pr+ + 
T r _]/2. With this and zero velocity, the Navier-Stokes 
equation becomes 

/ an 00 A T \ dp (z) . . 

= - jnoo - — — s j mg - (3.34) 

Hence the pressure profile in conduction is 



Po(z) = Poo - n 00 mgz + 



onoomgAx^ (3 35) 
2L Z 



For future use, the heat flow per unit area in conduc- 
tion is 



4o- A (i: 



dT (z) -AA T 



(3.36) 



Regarding convection as a perturbation on conduction, 
the temperature may be written 



T tot {r,t)=T (z)+T(r,t), 



and similarly the pressure, 



Ptot(r,i) =Po(z) +p(r,t). 



(3.38) 



(3.39) 



Since the velocity is zero in conduction, the full veloc- 
ity field is the same as the perturbing velocity field, 
v to t(r,£) = v(r, i). These convective fields depend upon 
the Raylcigh number and, in the calculations below, the 
wave number of the steady state being characterised, but 
these will not be shown explicitly. 

The full fields satisfy the density, Navier-Stokes, and 
energy equations. But since the conductive fields also 
satisfy these equations, they can be subtracted from both 
sides, so that one has 



= V-v(r), 



(3.40) 



mnoo — ^ — = an oT(r)mgz - Vp(r) + ryV 2 v(r), 



dt 



and 
dT(r,t) 

Cp dt 



(3.41) 



= -cpv(r) • V[T (z) + T(r)] + AV 2 T(r) 

= _£i^l Wz ( r )_ CpV ( r ) . VT(r) + AV 2 T(r). 

L* z 

(3.42) 



In the steady state the left-hand sides are zero. Here the 
left hand side of the final term will be retained as non- 
zero. This is useful both as an iterative device (simple 
time stepping) for the computer algorithm to obtain a 
converged steady state solution, and also to obtain the 
physical properties of the system during the evolution in 
time either from conduction to convection of during the 
transition from one convecting state to another. This 
implicitly assumes rapid relaxation of the velocity at each 
time step, dv/dt = 0. 

If one regards the convective perturbation as small, 
then one sees that the second term on the right-hand side 
of the energy equation is non-linear, as it is the product 
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of the convective temperature and the velocity. This non- 
linear term fixes the amplitude of the fields that give the 
steady state, since without it everything could be multi- 
plied by a constant to give another solution. There are 
five equations (the Navier-Stokes equation is for three 
components) and five fields, including the three compo- 
nents of the velocity. 

Now use L z as the unit of length, —At as the 
unit of temperature, L 2 c p /X as the unit of time, and 
mriQoX 2 / L 2 c 2 as the unit of pressure. Denoting dimen- 
sionless quantities with an asterisk, one has 







-— = KVT*z - v y 



~dt 



pv'V 



and 



dT* 
~dt* 



V*T* + V* 2 T* 



Here the Rayleigh number is 

7Z = — ATagCpirmooL^,/ Xr], 
and the Prandtl number is 

V = rjc p /mn Q0 X. 



(3.43) 



(3.44) 



(3.45) 



(3.46) 



(3.47) 



Here and throughout, c p is the constant pressure heat 
capacity per unit volume. 

One can eliminate the pressure from the Navier-Stokes 
equations. Set the left-hand side to zero, differentiate the 
^-component with respect to y, the y-component with 
respect to z, and subtract, 



= K 



dT* 
dy* 



7*2 



dy* 



dz* 



(3.48) 



The Prandtl number has been factored out. Similarly for 
the re-component, 



= K 



dT* 

dx* 



dx* 



dz* 



(3.49) 



One now has four equations (these two forms of the mo- 
mentum equation, the density equation, and the energy 
equation), four fields (T*, v*, v*, and v*), and one di- 
mensionless parameter, 1Z. Since everything in these 
equations is dimensionless and refers to the convective 
perturbation, the asterisk will be dropped later below. 



IV. TOTAL FIRST ENTROPY OF 
CONVECTION 

Now an expression for the first or structural entropy 
of a convecting steady state will be obtained as the dif- 
ference from the conducting state. (Quite generally the 



free energy is minus the temperature times the total first 
entropy^! and so the following results could be recast 
in terms of free energy, if desired.) The total entropy is 
the sum of the sub-system entropy and the reservoir en- 
tropy. Here the exact sub-system entropy will be given, 
and two forms for the reservoir contribution will be ob- 
tained. One reservoir expression is the exact change in 
reservoir entropy during the transition from one state 
to another (e.g. conduction to convection, or from one 
convecting state to another). The second reservoir ex- 
pression is the so-called static approximation. It gives 
the difference in reservoir entropy between a convecting 
state and the conducting state, and again it can be used 
to obtain the difference in reservoir entropy between one 
convecting state and another. 

The static approximation for the reservoir entropy 
in a non-equilibrium system was originally presented in 
Ref. [28, an d its nature is discussed in full detail in Ch. 9 
of Ref. 12. Briefly, the first entropy for phase space for a 
non-equilibrium system consists of a static part, which is 
the analogue of the usual equilibrium expression, and a 
dynamic part, which is a correction to the static reservoir 
contribution that accounts for the adiabatic evolution 
that is unavoidably included. In the present macroscopic 
description, the sub-system entropy is given exactly by 
the usual equilibrium expression, which will be obtained 
explicitly. The non-equilibrium reservoir entropy will be 
approximated by neglecting the dynamic part and using 
the static part alone. 

The change (or difference) in entropy density of the 
sub-system between convection and conduction can be 
obtained by thermodynamic integration of the tempera- 
ture from that in conduction, Tq(z) — Tqq + zAt/L Zi to 
that in convection T to t(r) = T (z) + T(r). (The depen- 
dence of the temperature field (and of the change in en- 
tropy) on the Rayleigh number and on the wave number 
of the particular convective state is not shown explicitly. 
Also, dimensionless variables are not used in this sec- 
tion.) Henceforth this will simply be called the convec- 
tive entropy density, the change from conduction being 
understood. Assuming, as in the Boussinesq approxima- 
tion, that the thermal expansivity and compressibility 
can be neglected, the convective entropy density of the 
sub-system is 



cr s (r) 



de 

mt de'- 



de? 



T' 



Cpln 



T (z) + T(r) 



T(r) T(r) 2 



T (z) 2T (z) 2 
T(r) zA T T(r) 



T 



00 



T T 2 



IT 2 
ZJ oo 



0(A|/T ( 



00/ 



(4.50) 
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This uses the fact that As;, 



CpAT, 



where c D is the 



heat capacity per unit volume. Since the convective tem- 
perature is T(r) ~ O(At), the expansion to quadratic 
order in the temperature difference is justified. (This 
expansion has been checked numerically against the full 
logarithm and found to be accurate for ideal straight rolls 
over the full range of Rayleigh numbers and wave num- 
bers.) This is the local sub-system entropy density. The 
global sub-system entropy density is 



<Ts(t) 



-1- J dr a s (r,t), (4.51) 



where A is the cross-sectional area of the sub-system. For 
use below during convective transitions, this has been 
written as a function of time and invokes the instanta- 
neous temperature, T(r,t). 



Static Reservoir Entropy 



The zeroth and first temperatures of the reservoirs 

29 



ar< 
1 

and 
1 

7k = 



1 

IT 



i 



1 

t7- 



i 

Too 



= ^+O(A|/T 2 ), (4.52) 



+O(A 3 T /T* ), (4.53) 



T T 2 



respectively. These correspond in essence to the aver- 
age temperature and to the temperature gradient of the 
reservoirs. With these, the static part of the reservoir 
entropy associated with the sub-system is 



-AE AE X 



(4.54) 



Again it is understood that this is the change from con- 
duction. The energy moments of the sub-system are de- 
fined as 



AE n = J dr z n Ae(r). 



(4.55) 



In view of this one can define the static convective reser- 
voir entropy density, 



CTr,st(r) 



-Ae(r) zAe(r) 



l'O 



(4.56) 



What appears here is the change in total energy den- 
sity, which is composed of the internal energy density, 
the gravitational energy density, and the kinetic energy 
density, 



Ae(r) = Ae int (r)+Ae g (r)+Ae kc (r) 

mnoo 

= CpT(r) - amn ogzT{r) H — 



v(r) ■ v(r). 

(4.57) 



Accordingly, the change in total entropy density, 
0tot,st( r ) = CT s(r) + 0r iS t(r), is composed of three anal- 
ogous terms. The internal energy density contribution 
includes the sub-system entropy and is 



Ae int (r) zAe int (r) 



T(r) zA T T(r) T(r) 2 
Too 



2T 2 

ZJ 00 



00 



c p zA T T(r) 
T T 2 



IT 2 

ZJ 00 



fT(r) 



(4.58) 



This is identical to the equilibrium fluctuation expression 
for the total entropy density of a sub-system in equilib- 
rium with a reservoir of temperature Too when the local 
fluctuation in energy is A£j nt (r) = c p T(r). It is what one 
would have expected and could have been written down 
directly. The fact that this is always negative means that 
a convecting steady state has lower total entropy than the 
conducting state, at least as far as the rearrangement of 
the internal energy in the convecting system is concerned. 
This latter observation is not particularly significant be- 
cause the result depends upon the static approximation, 
and so it does not give the full change in the reservoir 
entropy during such a transition. 

The gravitational contribution is 



T g M _ Ae g (r) zAe g (r) 

7 tot,stl x 7 — 



To Til 

amnoogzT(r) aran^gz 2 A^T(r) 



(4.59) 



oo 



T T 2 



and the kinetic energy contribution is 



ke 
; tot : st 



(r) 



Ae ke (r) zAe ke (r) 



TrO 
TO7100 



2T ( 



00 



v(r) • v(r) 4 



ttotooAt^ 
2L z Tq 



(4.60) 
v(r) • v(r). 



In the case of ideal straight rolls, there is an up-down 
symmetry so that the convective temperature perturba- 
tion is anti-symmetric upon reflection through the center 
of a convective roll. This means that the final term on 
the right-hand side of each of these integrates to zero. 

The sum of the last three results represent the static 
approximation to the convective entropy density (i.e. the 
difference in entropy between the convective state and 
the conductive state). Integrating over the volume of the 
sub-system, the global convective entropy density is 



Ctot.st 



int 
tot.st 



(r) 



'tot, St 



(r) 



ke 



t(r)] • 
(4.61) 
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2. Change in Reservoir Entropy 

The reservoir contribution to the above result for the 
convection entropy is approximate, whereas the sub- 
system entropy is exact. However, by integrating over 
time the heat flow through the sub-system from one reser- 
voir to the other, one can obtain exactly the change 
in reservoir entropy for a transition between two non- 
equilibrium states. 

The formally exact rate of change of the entropy of the 
reservoirs is 



S r (t) 



dx dy 



-]—J E (x,y,L z /2,t) 
1 i+ 



- jr-JB(x,y,-L z /2,t) 

J 2 T / dxdyJ E (x,y,L z /2,t) 
J oo J A 
-L Z A T \ f J J dT(v,t) 



T 2 



dx dy 



dz 



(4.62) 



=L z /2 



The first equality is exact, whereas the second equality 
makes the approximation that the integrated heat flux at 
the two boundaries are equal. This is certainly the case 
in the steady state, and it is a very good approximation 
in the transitions between steady straight roll states that 
are characterised below. This approximation does not ac- 
count for any nett total energy change of the sub-system 
during a transition, such as those in the gravitational en- 
ergy and in the kinetic energy, but these are negligible 
compared to the total heat flux over the time interval of 
a transition. Using this, the change in total entropy per 
unit sub-system volume during a transition over the time 
interval is 



L y = 1 or a 3.1 corresponds to a roll whose width and 



height are approximately equal. 



A. Hydrodynamic Equations 

The hydrodynamic equations for convection were given 
at the end of mil CI For the present ideal straight rolls 
with their axis in the x-direction, the x-component of ve- 
locity and the x-derivatives are zero. The three equations 
for the remaining three fields are 







dv y (y,z) dv z (y,z) 



dy 



dz 



(5.64) 



dT(y,z) 
dt 



v z {y,z) - Vy(y, z) — v z (y,z" 



dy 

d 2 T(y,z) , d 2 T(y,z) 



dy 2 



and 



= T^iil+v 2 



n 



dy 

d 2 T(y,z) 
dy 2 



dz 2 



dv z (y,z) dv y (y,z) 



dz 

(5.65) 



dy 2 



dy 

dz 2 



dz 



v z (y,z). (5.66) 



The second equality follows by taking the y-derivative of 
the first equality and using the vanishing of the diver- 
gence of the velocity. Recall that the Rayleigh number is 
1Z = — amgnooCpATLl/ Xrj. 



B. Fourier Expansion 



AtJtot = cr s (i 2 ) - cr s (ti) 



1 



AL, 



dtS r {t), (4.63) 



where the global sub-system entropy density is given by 
Eq. (14~5T1) . 



V. IDEAL STRAIGHT ROLLS 

This and the following section set out the hydrody- 
namic equations used for convection and describes the 
computer algorithms that were used to solve them. This 
section deals with ideal straight rolls (i.e. the rolls are 
considered straight and homogeneous in the x-direction) , 
and the next section deals with the cross roll state (i.e. 
the combination of straight x- and y- rolls). 

The applied thermal gradient and gravity are in the 
z-direction. The wavelength is twice the width of an 
individual roll, A — 2L y , as they come in pairs of counter- 
rotating rolls, and the wave number is defined as a — 
2tt/A. 

In this and the following sections, dimensionless vari- 
ables are used, with the asterisk being dropped. Hence 



Following Busse^ a Galerkin method is used that in- 
vokes Fourier expansions of the fields. The temperature 
field is expanded as 

L N 

T(y,z) = P?» sin 2nnz 

1=0 n=l 

+Tf n cos(2?i - 1)ttz] cos lay. (5.67) 

The form of the z-expansion is chosen to guarantee the 
boundary conditions, T(y, ±1/2) = 0. For the Boussi- 
nesq fluid, there is mirror plane symmetry between two 
rolls, T(y, z) = T(—y,z), and point reflection symmetry 
within a roll, T(y, z) = —T(L y — y, —z). These mean that 
the even I coefficients of Tf and the odd I coefficients of 
Tf n must vanish. 

The particular solution of the differential equation for 
the velocity is 



v l{y, z ) = [ v Zn sin 2n7TZ 



+v zln cos(2n — l)nz coslay. (5.68) 
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Clearly, 



and 



n(la) 



zM [{la) 2 + (2mr) 2 ] 2 



K(la) 



" zM ~ [(la) 2 + ((2n - l)^) 2 ] 2 



(5.69) 



(5.70) 



The homogeneous solution, which satisfies V 2 V 2 «!j = 
0, is 



v^(y,z) = [A* sinh laz + Bfz cosh Ic 



(5.71) 



+A^ cosh Zaz + B\z sinh Zaz] cos lay. 

Because the system is periodic in the horizontal direc- 
tion, there is a term for each expansion mode. Writing 
the velocity as v z = + u~, the four boundary condi- 
tions for each mode, v z (y, ±1/2) = dv z (y, ±1/2)/ 'dz = 0, 
determine the four coefficients per mode, A*, Bf A°, and 
Bf. These coefficients have the Boussinesq symmetry dis- 
cussed above. The second condition ensures the vanish- 
ing of v y (y,H/2) when the density equation is applied. 

The vertical velocity field is then projected onto the 
Fourier grid used for the temperature field using the or- 
thogonality of the trigonometric functions. Formally one 
has 

L N 

Vz{y,z) = ^2 [ V l,ln Sin 2n7TZ 

1=1 n=l 

i n cos(2n — l)nz] coslay. (5.72) 

Due to the Boussinesq symmetry, half the coefficients are 
zero. The horizontal velocity may be expanded as 

L N 



1=1 71=1 



+Vy i n sin(2n — l)nz\ sin lay. (5.73) 
The density equation gives 



-2mt 



J V,ln 



(2n- 1)tt 



, "z,ln and V l,ln = — v hn- ( 5 - 74 ) 

la ' la 

The rates of change of the temperature coefficients are 
obtained from the non-linear energy equation, Eq. f|5 . 65[) , 
again using trigonometric orthogonality. The left-hand 
side of this equation is dT/dt, which is non-zero in the 
approach to the steady state. Hence one can update the 
temperature field by simple time stepping, with the new 
temperature coefficients obtained by adding a constant 
A t ~ 0(1O~ 4 ) times the right-hand side to the previous 
value. 

Linear stability analysis reveals that the critical 
Rayleigh number is 1Z C — 1708 and the critical wave 
number is a c = 3.1 17i 25 ' 26 For a given Rayleigh num- 
ber 1Z > 1Z C , there is a range of wave numbers a that 
yield steady state solutions. These are the neutrally sta- 
ble states. Of these, some wave numbers are unstable to 
the cross roll and other transitions. 



C. Nusselt Number 

The Nusselt number is the ratio of the total heat flux 
in convection to that in conduction at a given Rayleigh 
number. The heat flux in conduction is just Fourier's law, 
jcond _ ^\a t . Since the velocity vanishes at the hor- 
izontal boundaries, the heat flux in convection is purely 
conductive across these boundaries. Integrating over a 
single convection cell, the Nusselt number is 



1 



T T 



d (_ X ) artota '^' z ) 

cond / hJ \ } 



dz 



N 



z=±l/2 

(5.75) 



The temperature in the integrand is the sum of the con- 
ductive temperature field plus the convective perturba- 
tion, Eq. (|3.38[) . The conductive part gives rise to the 
first term, 1, and the convective terms involving sin2n7T2: 
and I — give rise to the remainder. 



D. Algorithms 

1. Stable States 

The Fourier expansion of the temperature and veloc- 
ity fields in conjunction with the hydrodynamic equations 
given above were used to develop two different algorithms 
for ideal straight roll convection. The first algorithm was 
used to characterise neutrally stable straight roll con- 
vection. For each such steady state, single time quanti- 
ties such as the temperature and velocity fields, the heat 
flow, Eq. (|5.75p . and the static part of the total entropy, 
Eq. (|4.6ip . were determined. In this first ideal straight 
roll case, a wave number a typically in the neutrally sta- 
ble range [2, 10] was chosen, with L ps N ss 10. Neutrally 
stable means that a steady state ideal straight roll solu- 
tion exists at that wave number and Rayleigh number. 
This solution might be unstable to perturbations, either 
to straight roll states with a different wave numbers, or 
to other convecting patterns. 

The algorithm proceeded using the equations give 
above with simple time stepping, T^ c (t+ A t ) = T^ c (t) + 

A t Ti^ c (t). Usually, the initial point was chosen as a 
small non-zero value in some low order modes, for ex- 
ample Tq ! = Tfj = 10 -3 . No changes to the results 
were observed using other starting points. In some cases, 
particularly at higher Rayleigh numbers or toward the 
extremities of the neutrally stable range, a previously 
converged steady state solution at a nearby wave num- 
ber or Rayleigh number was used as the starting point. 
When converged, the final steady state represented ideal 
straight roll convection parallel to the y-axis of wave- 
length A = 2ir/a. Most of the power was in the fun- 
damental mode a, with the next most prominent mode 
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TABLE I: Measured (silicone oil, V = 930) and computed 
velocity amplitudes, (/im/s), for the first three harmonics * at 
a — 3.117 and two Rayleigh numbers. 

Measured^ Busse— Present Measured^ Present 
ft = 3416 ft =11,391 



Vy 1 


132±4 


133 


137.6 


337±10 


355.1 




5.34^0.5* 


5* 


5.1* 


13.7±1 


13.0 


V 3 


1.5±0.3 




1.2 


19±1 


18.3 


V 1 
1 z 


145±5 


138 


140.6 


340±10 


363.0 


V 2 

1 z 











1.7±2 





V 3 

1 z 


4± 0.4 


3.8 


3.9 


58±4 


60.2 



*The V z are at z** 
% kt z* = 0. 



being 3a. In this type of calculation the fixed wave num- 
ber determines the final steady state. It is most useful 
for obtaining thermodynamic properties as a function of 
the steady state wave number, for example, the heat flux, 
the static part of the entropy, and the velocity fields. 

The Nusselt number was monitored and used to halt 
the iterative procedure when its relative change was less 
than 10 -5 . For many of the results reported below, N 
1 and L = 10. Some tests were carried out with up to 
N = 16 and L = 16. By comparison, Busse- 30 used up to 
L + N = 12. In general, three- or four- figure agreement 
was obtained between the present results and those of 
Busse for Rayleigh numbers up to 30,000. 

The amplitudes of the first three harmonics of the ve- 
locity field in convection have been measured by Dubois 
and Bcrgc for a silicone oil (V = 930) constrained at the 
critical wavelength i 31 ' 32 Their results are shown in Ta- 
ble U together with their reports of the results of Busse's 
calculations, and with the results of the present calcula- 
tions, which should be equivalent to those of Busse (apart 
from the non-linear influence of the greater number of 
modes used here). There is quite good agreement be- 
tween all three, which confirms both the validity of the 
present computational algorithm and the applicability of 
the hydrodynamic model to the experimental situation. 



2. Conduction-Convection Transition 

In the second type of straight roll calculation, a small 
wave number was chosen as the fundamental, a 0.2-0.5, 
and a large number of modes were used, L sa 60-100 and 
N ss 10. A number of different initial states were tested 
including uniform distributions as well as Gaussian distri- 
butions of the temperature coefficients, and white noise. 
It was found that the system converged to a straight roll 
steady state that was an odd harmonic of the small wave 
number, a — (21 + l)a. (The odd harmonic is demanded 
by the Boussinesq symmetry.) The final mode was iden- 
tified from the power spectrum. 



It was confirmed that the properties of the convecting 
state given by this second algorithm were equal to those 
given by the first algorithm with fundamental wave num- 
ber equal to a. 

This second type of calculation modeled the conduc- 
tion to straight roll convection transition. Whereas the 
first calculation tells the possible straight roll steady 
states at a given Rayleigh number, the second calcula- 
tion tells the most likely straight roll steady state that 
results from a transition directly from the conducting 
state at a given Rayleigh number. The modal power, 
the sub-system entropy, and the reservoir entropy were 
monitored as a function of time during the transition. 

At each Rayleigh number 6-19 independent trials were 
performed. The most likely wave number a for each trial 
was recorded (this is the most likely out of all possible 
wave numbers la), as well as the average of these over all 
the trials, (a). 

It is important to note that the outcome of this second 
algorithm does not refer to the most likely (or average) 
state, but rather to the most likely (or average) transi- 
tion from the conducting state. This appears to be a 
general point that will be confirmed in the results given 
below: for non-equilibrium systems, one cannot speak of 
the most likely phase, but only of the optimum transition 
from the current phase. 



VI. CROSS ROLL STATE 
A. Hydrodynamic Equations and Conditions 

This section sets out the computational algorithm 
that is used for cross roll convection. It is supposed 
that the system is periodic in the x and y directions, 
T(x, y, z) = T(x + mk x , y + nk y , z), m,n = ±1, ±2, . . . 
The wavelength is twice the width of an individual roll, 
as they come in counter-rotating pairs, A^ = 2L X and 
k y = 2L y . The wave numbers are given by k x — 2ir/a x , 
and A y = 2n/a y . 

The four hydrodynamic equations for the four fields, 
(temperature and three velocity components) are explic- 
itly 







dv x 
dx 



dvy_ 
dy 



dT 
~dt 



d 2 T 
dx 2 
dT 

'x 

dx 



dz ' 

d 2 T d 2 T 
dy 2 dz 2 
dT dT 



(6.76) 



dy 



dz 1 



and 



= 7^ + V 2 
dx 



o = t4^ + v 2 

dy 



dv z 
dx 

dv z 
. dy 



dv x 
dz 

C)Vy 

dz 



(6.77) 
(6.78) 

(6.79) 
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Taking the x derivative of the penultimate equation, the 
y derivative of the final equation, using the density equa- 
tion, and adding them together gives, 



= K 



d 2 cfj 
dx 2 dy 2 



T + 



d 2 d 2 d 2 

dx 2 dy 2 dz 2 



-i 2 



= TlVlT + V 2 VV 



(6.80) 



In all these equations, the temperature and velocity fields 
are all functions of the position, r = {x,y, z}. In the 
steady state they are not functions of time, but in a tran- 
sition between states they are. 



The Boussinesq symmetry refers to the reflection sym- 
metry within a roll. For r = {x,y, z}, define = 

{L x X, Lrf. 



jy — y, — z}. One must have 
T(r) = -T(rt), and v(r) = -v(i-t) 



(6.85) 



These basically say that the convective temperature per- 
turbation at the top of an up draught must be equal and 
opposite to that at the bottom of a down draught. It 
may be confirmed that the hydrodynamic equations in 
Boussinesq approximation given above satisfy this sym- 
metry. 



1. Boundary Conditions 

The temperature that appears here is the perturbation 
due to convection. That is, the conductive solution has 
been subtracted from these equations. This means that 
the temperature perturbation must vanish at the upper 
and lower boundaries, 



T(x,y, ±1/2) = 0. 



(6.81) 



Since no fluid can cross the boundaries one must also 
have 



v z {x,y,±l/2) = 0. 



(6.82) 



The boundaries are solid walls at which the fluid sticks, 
so that one also has 



v x {x, y, ±1/2) - v y {x, y, ±1/2) = 0. 



(6.83) 



Since this last 
dv x (x,y,±l/2)/dx 



equation implies that 
dv y (x,y,±l/2)/dy = 0, the 



density equation implies that dv z (x, y, z)/dz 



z=±l/2 



= 0. 



2. Symmetry 

The fundamental convection cell, — L x < x < L x and 
—L y < y < L v , contains two counter rotating rolls in 
each direction. Hence there is mirror plane symmetry at 
x = and at y = 0. This means that 

T(x,y,z) = T(-x,y,z) = T(x,-y,z), 

v x (x,y,z) = -v x (-x,y,z) =v x (x,-y,z), 

v y (x,y,z) = v y (-x,y,z) = -v y (x,-y,z), 

v z (x,y,z) = v z (-x,y,z) = v z (x, -y,z). (6.84) 

These mean that the expansion for the temperature must 
be even in the lateral coordinates, and so must consist 
of terms like T qp {z) cos(qa x x) cos(pa y y), q and p being 
non-negative integers. A similar expansion holds for v z . 
Obviously for v x and v y the respective cosine is replaced 
by a sine. 



B. Fourier Expansion 

In view of the Boussinesq symmetry and the facts that 
cos(qa x (L x — x)) = (— l) q cos(qa x x) and cos(pa y (L y — 
y)) = (— l) p cos(pa y y), one sees that T qp (z) must be an 
odd function of z if q +p is even, and it must be an even 
function of z if q + p is odd. Since T(x, y, ±1/2) = 0, and 
since sin(2n7rz) and cos((2n+ l)irz) vanish at z = ±1/2, 
the expansion for the temperature is 



Q 



N 



T(r) 



^2 X! X! T ip n cos qa,xX cos P a vv 

q=0 p=0 n=0 

sin 2mrz, q + p even, 
cos 2n'nz, q + p odd, 



(6.86) 



where n' = (2n+ l)/2, and T qp0 = if q + p is even. The 
vertical component of velocity has a similar expansion 

Q P N 

Vz(r) = ^2^2^2v* pn cos qa x x cos pa y y 

q=0 p=0 n=0 

sin 2m: z, q + p even, 



cos 2n'irz, q + p odd. 



(6.87) 



The x component of velocity has the expansion 

Q P N 

v x(r) = ^EE"w" sin qCLxX cos pa y y 

q=0 p=0 n=0 

cos 2n'irz, q + p even, 



sin2n7rz, q + p odd, 
with Vq pu = 0. Similarly 



(6.88) 



Q P N 
q=0 p=0 n=0 

x f cos2n'7rz, q + p even, , g gg > 

y sin2n7rz, q + p odd, ^ ' ' 

with v q0n = 0. These latter two expansions arise from the 
Boussinesq symmetry and the vanishing of the velocity 
at z = ±1/2. 
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1. z-Component of the Velocity 

Inserting the expansions for the temperature and the 
^-component of the velocity into Eq. (|6.80[) and setting 
the coefficients of each term to zero gives the particular 
solution 



-R[{qa x ) 2 + {pa y ) 2 ] 
[(qa x ) 2 + (pa y ) 2 + M 



T 

212 <?P" 



where 



M r 



2mr, 



q + p even, 



(2n + 1)tt, q+p odd. 



(6.90) 



3.91) 



Note the distinction between the superscript p, for par- 
ticular, and the subscript p, an integer index. 

The homogeneous solution satisfies V 2 V 2 w!, 1 ( r ) = 0. It 
has the expansion 



p 

;^(r) = cos ga x x cospa y y 

q=0 p=Q 

fqp( z ), q+P even 
f™(z), q+p odd. 



x < "M) V H . * 77' (6.92) 



Here it may be readily verified that the odd homogeneous 
solution is 

fqpi z ) = A qp sinh(a gp z) + B qp z cosh(a qp z), (6.93) 
and that the even homogeneous solution is 



fqp(z) = A qp cosh(a 9P z) -I- BqpZ smh( 



'■qp^lt 



with 



a qp = \J (qa x ) 2 + {pa v ) 2 



(6.94) 



(6.95) 



Even and odd in this context refer to the parity with 
respect to z. 

With v z (y) = v!?(r) + Vz(r), the four boundary condi- 
tions, v z (x,y,±l/2) = and dv z (x,y, z) / dz\ z=±1/2 = 0, 
determine the coefficients A qp and B qp in the even and 
odd cases. It is straightforward to use the orthogonality 
properties of the trigonometric functions to obtain the 
Fourier coefficients, v 7 ' . 



2. x- and y -Components of the Velocity 

The lateral components of the velocity can be written 
in the form 

Q p 

v x {r) = ^2^2 fg p (z) sin qa x x cos pa y y, (6.96) 

<J=0 J9=0 



and 



Q P 



,(r) = ^2^2 fy p (z) cos qa x x sin pa y y. (6.97) 



In view of Eqs (|6.78[) and (16.791) , one has 

fq P ( z ) = qaxfq P {z), and j v qp (z) =pa y f vp (z). (6.98) 

Inserting these into the density equation, V • v(r) = 0, 
and equating the lateral coefficients term by term yields 



fgp(z) 



1 



(qa x ) 2 + {pa y ) 2 



N 



qpn 



(-2mr)cos(2mrz), q + p even,, _ , 
* (2n'7r)sin(2n'7rz), q + p odd. 



q=0 p=Q 



The boundary condition v(x, y, il/2) = is automati- 
cally satisfied, having already been invoked in the solu- 
tion of the z-component of the velocity. These solutions 
for the horizontal velocity can now be projected onto the 
original z-expansions, Eq. (|6.88[) and Eq. (|6.89|) . 



C. Algorithm 

This cross roll algorithm was used to model the cross 
roll transition from a steady straight roll state with wave 
number a y to an orthogonal straight roll state with wave 
number a x . As in the first form of the ideal straight 
roll algorithm described in WD 1[ a y was fixed typically 
in the neutrally stable range ss [2, 10], with P = 6 and 
N = 6. (The P used here replaces the L used there.) 
This gave an adequate description of the straight rolls in 
comparison with the benchmark L — N = 10 calculations 
reported there. A small £-wave number, a x ~ 0.1-0.5, 
and a large number of modes, Q s» 60-150 were used. 

For the initial state, a steady straight roll state of wave 
number a y generated by the first algorithm was used. In 
most cases, the value chosen for the initial wave number 
lay toward one of the extremities of the range of neutrally 
stable wave numbers for the Rayleigh number in the ex- 
pectation of a transition to an intermediate wave num- 
ber. The steady state temperature field was perturbed 
by adding an independent random number to each T qpn 
(white noise). The amplitude of the noise was propor- 
tional to the square root of the total power in the ini- 
tial steady state. Typically, following the addition of the 
perturbation, the total power in the j/-modes increased 
by about 10%, and the total power in the x-modes was 
twice as great as that in the y-modes, with w 15 times 
as many x-modes as y-modes. A cross roll transition 
usually occurred to ideal straight rolls in the x-direction, 
with a x = (2q + l)a x ~ 3-4.5. Simple time stepping was 
used to obtain the evolution of the temperature field. The 
modal power, the sub-system entropy, and the reservoir 
entropy were monitored during the transition. 

In some cases the computational burden was reduced 
by only allowing fundamental modes within a window 
about the likely outcome. That is, the temperature and 
velocity coefficients were set to zero unless they cor- 
responded to an integer multiple (including zero) of a 
wave number within the window. Typically, a window 
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FIG. 1: Components of the convective entropy density (log 
scale) at 1Z = 5000. The solid curve is the gravitational con- 
tribution, Eq. (|4.59[) . the long dashed curve is the negative 
of the kinetic energy contribution, Eq. ([4. 6011 . and the short 
dashed curve is the negative of the internal energy contribu- 
tion, Eq. H4.58|) . The dotted curve is the sub-system entropy, 
Eq. (|4.51[) . The crosses mark the maximum of each curve. 



1-2 wave numbers wide halved the number of possible 
Fourier modes, and reduced the computer time by al- 
most an order of magnitude. Tests with and without 
the window showed that it had little or no effect on 
the computed transitions. For example, at a Rayleigh 
number of 1Z — 5000, and for an initial wave number 
of a y — 4.3, the average final wave number following 
the cross roll transition was (a x ) = 3.32 ± 0.05 using a 
wave number step of a x = 0.15 and no window, it was 
(a x ) = 3.32±0.06 with a x — 0.16 and a window [2.5,4.5], 
and it was (a x ) = 3.21 ± 0.04 with a x =0.11 and a win- 
dow [2.9,4.0]. The standard deviation of the transitions 
appeared to depend upon the wave number step, with it 
being larger than or equal to the wave number step. 

These equations for cross roll convection and their 
computational implementation have been tested by set- 
ting Q = and comparing the steady state results with 
those obtained with the independent straight roll pro- 
gram. 



VII. CONVECTION THEORY AND 
EXPERIMENT 

In this section the results of the convection calcula- 
tions are presented using the material properties for a 
typical silicone oil with v = 0.L 31 i 32 Figure Q] shows the 
three contributions to the convective entropy density at 
1Z = 5000. This is the difference in entropy between con- 
vection and conduction calculated using the static part 
of the reservoir entropy, as described in mVl The figure 
also shows the sub-system entropy density (i.e. the differ- 
ence in the sub-system entropy between the convecting 
state and the conducting state) . All of the wave numbers 
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FIG. 2: Change in entropy density during a spontaneous 
straight roll transition from conduction at 1Z = 5000. The 
solid curves are for a — 3, the dashed curves are for a — 2, 
and the dotted curves are for a — 4. In the main figure, the 
curves are the change in the total entropy density, Eq. (|4.63|) . 
In the inset, the lower three curves are the internal entropy 
part of the static convection entropy, Eq. (I4.58I) . the upper 
three curves are the sub-system entropy, Eq. (|4.51[) . an d the 
horizontal line is a guide to the eye. 



in this and the following figures correspond to hydrody- 
namic steady states, with the low wave number end of 
the curves signifying the limit to the steady state ideal 
straight roll solutions to the Boussinesq equations. These 
are the so-called neutrally stable states for which steady 
state straight roll solutions exist. The central region of 
the neutrally stable region is absolutely stable, (i.e. per- 
turbations decay and the original straight roll state re- 
mains). The extreme wave numbers toward the bound- 
aries of the neutrally stable region are generally unstable 
to perturbations, which result in either a new straight 
roll state with a different wave number, as might occur 
via the zig-zag or cross roll transition, or else another 
type of convective pattern. 

It can be seen that the entropy due to the convective 
temperature field itself, the internal energy contribution 
Eq. (|4.58[) . is about six orders of magnitude greater than 
the entropy directly due to gravity, which in turn is about 
two orders of magnitude greater than the entropy due to 
the kinetic energy. These results are typical for the whole 
range of Rayleigh numbers. Hence due to this dominance 
it makes no difference whether one discusses the full static 
form of the convective entropy or just the internal energy 
contribution. The sub-system entropy itself, Eq. (|4.51l) . 
is comparable in magnitude to the static convective en- 
tropy, but it is positive. It decreases in magnitude ap- 
proaching the limits of the range of steady state solutions 
and actually becomes negative at the low wave number 
end in most cases. 

The static convective entropy difference, which, as 
shown in Fig. [TJ is dominated by the internal energy, 
is negative. One should not conclude from this that 
the convecting state is thermodynamically unfavorable, 
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FIG. 3: Sub-system entropy density for ideal straight roll 
convection for wave numbers in the region of neutral stability, 
for Rayleigh numbers from 2000 (bottom) to 6000 (top), in 
steps of 1000. The dashed curve shows the maxima. 
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FIG. 4: Nusselt number as a function of wave number, for 
Rayleigh numbers from 2000 (bottom) to 8000 (top) , in steps 
of 1000. The maxima are shown by the dashed curve. 



since this would contradict the hydrodynamic calcula- 
tions, which show that the convecting states are stable 
and arise spontaneously from the conducting state with 
an initial perturbation. It can be seen in Fig. [2] that the 
change in the total entropy density, Eq. (|4.63|) . during 
a straight roll transition is positive. This contrasts with 
the static part of the entropy difference, Eq. (I4.58|) . which 
is negative throughout the transition. The difference in 
the sub-system entropy, Eq. (|4.51|) . is mainly positive, 
but not during the entire transition. (The initial data 
for a — 2 in the inset, which can only just be resolved 
on the scale of the figure, is negative.) The slope of the 
change in total entropy density is the dissipation (the rate 
of entropy production of the reservoirs), which is propor- 
tional to the Nusselt number for each case. It can be 
seen that it is constant at longer times as the sub-system 
achieves its final structure. The entropy change of the 
reservoirs completely dominates the change in entropy of 
the total system during the transition. It is always found 
that the change in the total entropy density is positive at 
each stage of the conduction-convection transition. This 
means that there is indeed consistency between hydrody- 
namic stability and the Second Law of Thermodynamics. 

Figure [3] shows the difference in the sub-system entropy 
between convection and conduction, Eq. (|4.51|) . for ideal 
straight rolls as a function of wave number for several 
Rayleigh numbers. Steady state straight roll solutions 
could be obtained in the range 1708 <1Z< 55, 000, with 
the range of neutral stability increasing with increasing 
Rayleigh number (at least initially). It can be seen that 
at a given wave number, the sub-system entropy den- 
sity increases with increasing Rayleigh number, and that 
it approaches zero toward the ends of the stable range. 
The linear stability analysis of the hydrodynamic equa- 
tions predicts that the convective transition occurs at 
TZ C = 1708 and a c = 3.117^^ As the critical Rayleigh 
number is approached from above along the critical wave 
number, the sub-system entropy density approaches zero 



from above. Apart from the low wave number end of 
the steady state range, the change in sub-system en- 
tropy density from conduction was found to be positive. 
As mentioned in connection with Fig. [3J the sub-system 
entropy density was not always positive during the ap- 
proach to the steady state, and it was also negative in 
many stable states toward the low wave number end of 
the range. 

It can be seen in Fig. [3] that the first and the second 
derivatives of the sub-system convective entropy density 
vanish at the critical wave number and critical Rayleigh 
number. This is analogous to behaviour in equilibrium 
systems where entropy derivatives vanish at the criti- 
cal point. In convection, it is known that the hydrody- 
namic fluctuations diverge at the convective instability 
(see Ref . |33| and references therein) . The precise mean- 
ing of the vanishing of the sub-system entropy derivatives 
at the critical point and the connection with divergent 
hydrodynamic fluctuations is not clear to the present au- 
thor. 

Figure 0] shows the Nusselt number for various 
Rayleigh numbers as a function of wave number over the 
region of neutral stability. As in the preceding figures, 
the curves represent steady state straight roll convection. 
There is a well-defined wave number of maximum heat 
flux at each Rayleigh number, and this increases with 
increasing Rayleigh number. 

The significance of this figure relates to the discus- 
sion in fJTT] regarding the Principles of Maximum and 
Minimum Dissipation, which assert respectively that the 
optimum non-equilibrium state is determined by either 
the greatest or else the least rate of entropy production. 
Since the dissipation is linearly proportional to the Nus- 
selt number, if one or other of these principles were true, 
then the optimum wave number for straight roll convec- 
tion at each Rayleigh number could be read directly from 
Fig. 2J It can be seen that the wave number of minimum 
dissipation occurs at the large wave number boundary 
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FIG. 5: The ideal straight roll wave number following a 
spontaneous transition as a function of Rayleigh number (log 
scale). The open symbols are measured cross roll transitions^ 
and the closed circles and triangles are cross roll calculations 
(P = TV = 6, Q =100-150, a x = 0.1-0.2, error bars give 
the standard deviation, with the data shifted horizontally by 
±5%). The initial constrained state had a large wave number 
(triangles) , a medium wave number (crosses) , or a small wave 
number (circles). The closed squares (L — 100 and a y = 0.2) 
and closed diamonds (L = 150 and a y — 0.1) are the calcu- 
lated wave number following a conduction-convection transi- 
tion. The curves gives the calculated wave number of max- 
imum Nusselt number (solid curve) and of maximum sub- 
system entropy density, Eq. (|4.51[) . (dashed curve). 

of the neutrally stable range, and that the wave number 
of maximum dissipation is near the critical wave number 
and increases with increasing Rayleigh number. 

Fig. [5] compares several results for the wave number 
of ideal straight roll convection: those that result from 
spontaneous cross roll transitions, both experimentally 
measured 3 ^ and the present calculations, those calculated 
for a direct transition from conduction, and those cal- 
culated to give the maximum Nusselt number and the 
maximum sub-system entropy. 

The experimentally measured wave numbers are taken 
from Fig. 7 of Ref. [3J. The experiments were performed 
by initially constraining the system in a straight roll con- 
verting state with a wave number specified by means of 
a periodic temperature perturbation (obtained with an 
intense light source and shadow mask). Upon removal 
of the perturbation, there often occurred a spontaneous 
transition via an intermediate cross roll state to an or- 
thogonal straight roll state whose wave number is shown 
in Fig. [5] Only final states that resulted from a cross roll 
transition and that are entirely or predominantly straight 
rolls are analysed here. Spontaneous zig-zag transitions 
to straight roll states, also occurred but these are not in- 
cluded in the figure. The majority of the measurements 
of Busse and Whitehead— either did not result in a spon- 
taneous transition, or else did not have a final straight 
roll state, or else had too many defects; none of these were 
analysed. The measurements of Chen and Whitehead, 35 
did result in ideal straight rolls, but the data was prob- 



lematic because they were obtained in a cylindrical cell 
and because only the range of final wave numbers rather 
than the individual transitions was reported. Almost all 
other measurements in the literature of the convective 
wavelength could not be analysed for similar reasons: ei- 
ther no spontaneous transition occurred, or else the ini- 
tial state was not a straight roll state, or else the final 
state was not a straight roll state, or else there were many 
defects in the final stated - — 

It can be mentioned in passing that the measured wave 
numbers 3 ^ increase with increasing Rayleigh number, as 
can be seen in Fig. [5j Most measurements on convection 
reported in the literature show the opposite trend (see 
Refs . I43rl48l and also references in Ref. |49| ) . The reason for 
the difference is that most measurements are for curved 
convection rolls, due either to using a cylindrical cell, or 
else to the presence of point defects, and for these the 
hydrodynamic equations fix the steady state solutions 
to have a wave number that decreases with increasing 
Rayleigh number i^2r— 

Busse and Whitehead 34 classified the initial wave num- 
ber as small, medium, or large, as indicated by the sym- 
bols in Fig. [5] The experimental measurements indicate 
that the wave number can both increase and decrease 
in a spontaneous transition, depending upon the initial 
constrained wave number and Rayleigh number. It is 
difficult to see a systematic dependence on the initial 
wave number in the measured experimental data (but 
see Fig. [5] below). The measurements (and calculations) 
show that there are barriers to changing the straight 
roll wave number since continuous evolution of the wave 
number was not observed, and once the orthogonal wave 
number is established in the intermediate cross roll state, 
it remains as the wave number of the final straight roll 
state. Consistent with the calculations, there is a certain 
width or scatter in the measured final wave number at 
each Rayleigh number, which suggests that it depends 
upon the initial wave number, and also that it depends 
upon the initial state or the actual destabilising pertur- 
bation. 

The experimental data is compared in Fig. [5] with the 
calculated wave numbers that gives the maximum heat 
flux and the maximum sub-system convective entropy 
at each Rayleigh number. There is no real agreement 
between the observed final wave numbers and the wave 
number that maximises the heat flux or the sub-system 
entropy. There is some similarity in the observed and 
calculated wave numbers in that they tend to increase 
with increasing Rayleigh number. This similarity is no 
more than qualitative. These data provide evidence that 
neither the heat flux nor the sub-system entropy is max- 
imised in the non-equilibrium state. Since the static 
part of the entropy difference is negative, one can also 
conclude that it does not determine the non-equilibrium 
state. 

Results for the final wave number (a x ) of the cross roll 
transition algorithm described in WI Cl are also shown in 
Fig. [5J These use Q = 100 and a x = 0.2, or Q = 150 
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and a x = 0.1. Both small, a y = 2.2-2.4, and large, a y = 
4.3-6.0, wave number initial states were used, with white 
noise added as an initial perturbation. The number of 
independent trials for each initial wave number was 5— 
13. The bars in the figure signify the standard deviation 
of the transition rather than the standard error of the 
average final wave number. In some cases the standard 
deviation was observed to depend on the wave number 
step used in the calculations; it was generally not less 
than the wave number step. Each calculation was ter- 
minated when it was judged that no further transition 
would occur, generally on the basis that the power in the 
maximal x-mode was clearly dominant. The logarithm 
of the number of transitions observed from a given ini- 
tial wave number to a given final wave number is directly 
related to the second entropy of the transition. It can 
be seen in Fig. [5] that there is quantitative agreement 
between the calculated and measured final wave num- 
bers. This provides additional confirmation of both the 
cross roll computer program and algorithm and also of 
the applicability of the hydrodynamic model to the ex- 
perimental system. 

It ought be mentioned that there is the possibility of 
bias in the statistics in the present computations due to 
the judgement that has to be exercised in deciding that a 
transition to an ideal straight roll state has occurred. For 
example, for the case of a Rayleigh number of 1Z = 5000 
and an initial wave number of a y = 6.2, 16 trials were run. 
Of these, 7 had a clear transition to an ideal straight roll 
state by times t < 4, with an average final wave number 
(fl x ) = 3.01 ± .04. The remaining 9 trials exhibited Bloch 
states, in which two or more neighboring wave numbers 
were dominant with comparable power, and which were 
evolving exceedingly slowly. Five of these Bloch states 
were terminated at times t < 4 and discarded. The re- 
maining 4 were run until t = 11-13, with 3 ending up in 
a clear ideal straight roll state, with (a x ) = 2.77 ± .07, 
and the remaining 1 being terminated at t = 10.9 with- 
out a clear result (although it appeared to be converging 
toward a x — 2.9). If one had retained only trials with a 
clear transition by t — 4, then one would have obtained 
(a x ) = 3.01 ± .04. If one simply averaged over all transi- 
tions that had actually been completed, then the average 
is (a x ) = 2.94 ± .05. But this last result is biased because 
slowly evolving cases are the ones discarded and these 
would have had a smaller wave number if they had been 
allowed to go to completion. If one removed this bias 
by weighting the short and long time averages in the ra- 
tio 7:9 (i.e. according to the number of Bloch states), 
then the average is (a x ) — 2.88 ± .04. In summary, in 
this case (7Z = 5000, a y = 6.2) rapid transitions had a 
larger final wave number than transitions that took more 
time. Only a small minority of all the cases run were ter- 
minated without a result, and so it is likely that this 
potential bias does not have a significant effect on the 
computational results in Fig. [5] Whether or not it is a 
potential experimental problem is unclear. 

In addition to the cross roll transition, Fig. [5] also 
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FIG. 6: The calculated modal power during a cross roll tran- 
sition (71 = 5000, a y = 1.7, a x = 3.41, a x = 0.31, Q = 80, 
and P = N = 6). The solid, dashed, and dotted curves are 
the three rr-modes with highest power, and the dash-dotted 
curve is the total power in the y-modes. 



shows the average final wave number for the conduction- 
convection transition, (a y ), whose calculation was de- 
scribed in WD 21 White noise was used as a pertur- 
bation to initiate the transition. The average final wave 
number appeared insensitive to the wave number step 
(a y = 0.1 or 0.2), although the standard deviation was 
smaller for the smaller step. It was found that in most 
cases the system converged to a straight roll steady state 
that was an odd harmonic of the small wave number, 
a = (27 + l)a, as demanded by the Boussinesq symmetry. 
Beyond 1Z > 20, 000, ideal straight rolls did not result, 
or at least there was not a single clearly dominant wave 
number. (Some such Bloch states are included in the av- 
erages for 1Z = 15, 000 in Fig. [5]) It can be seen that 
the wave number resulting from the direct conduction- 
convection transition is larger than that resulting from a 
cross roll transition. 

These results show that the two types of phase transi- 
tion, conduction-convection and cross roll, differ signifi- 
cantly even though both result in the same type of final 
state, namely ideal straight rolls. At a given Rayleigh 
number, the ideal straight roll wave number depends 
upon whether it results directly from conduction, or 
whether it results from a cross roll transition (and, in 
the latter case, it depends on the initial wave number, as 
shown in Fig. [5] below). One can conclude from this that 
a single time variational quantity whose optimisation de- 
termines the favored non-equilibrium pattern either does 
not exist, or else has negligible influence compared to the 
barriers between the multiple possible patterns. This is 
likely to be a general feature of non-equilibrium systems, 
and instead of seeking 'the' optimum pattern or phase, 
one should focus on the optimum transition from a given 
phase. 

The transition between two orthogonal straight roll 
convective states via the cross roll intermediate state, as 
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FIG. 7: Change in entropy density during the cross roll tran- 
sition of the preceding figure. The solid curve is the change 
in total entropy density, Eq. (|4.63|) . the dashed curve is the 
change in the internal entropy part of the static convection 
entropy, Eq. (|4.58|l , and the dotted curve is the change in the 
sub-system entropy, Eq. (|4.51|) . The inset shows the Nusselt 
number. 



FIG. 8: The calculated final wave number function of 

the initial wave number a y for cross roll transitions at 1Z = 
10,000 (Q = N = 6, P = 100, and a x = 0.2). The symbols 
signify the most likely final wave number averaged over 6-12 
trials, and the vertical bars show the standard error on the 
mean. The vertical dashed lines bound the region of stable 
wave numbers for which no transition occurred. 



described in Wli can be monitored by the evolution of 
the power in the various modes, as shown in Fig. [5J In 
this case the system was initially in a convecting straight 
roll steady state with a y = 1.7, near the lower end of sta- 
ble states, and at t = white noise was added to all the 
modes. This increased the total power in the y-modes 
by about 10%, and created almost twice as much power 
in the a;-modes as in the y-modes, spread over thirteen 
times as many modes. The power in the ir-mode q was 
defined as P xq = ^2 n Tg 0n , and the total power in the 
x-modes was defined as P x = ^2 q P X q, and similarly for 
the y-modes. 

The initial white noise perturbation is meant to model 
the experimental situation, although the origin of the 
noise is unclear. It is possible that noise originates 
from mechanical vibrations or from temperature inho- 
mogeneities and water flow in the heat baths, in which 
cases white noise would likely be appropriate. Although 
the perturbation is small on the scale of the convective 
temperature, it is large on molecular scales, and so treat- 
ing it as a thermodynamic fluctuation (i.e. weighting it 
by the exponential of the entropy) would be problematic. 

Figure [6] shows that the power in the cc-modes grows 
over time at the expense of the initially stable y-modes. 
By about t ~ 0.6 the y-rolls have disappeared, and by 
about t« 1.5 a steady straight roll convecting state has 
been established with a x = 3.41 = 11 x 0.31. The Nusselt 
number at t = 1.88 was Af = 2.110, which compares well 
with J\f = 2.107 calculated using the ideal straight roll 
algorithm of f|V] for 1Z = 5000 and a = 3.4. It can be 
concluded from the figure that a cross roll transition from 
one straight roll state to another has occurred. It may 
be called spontaneous in the sense that no constraint was 
imposed on the final state (other than that it be an odd 



integer multiple of the wave number step) or indeed on 
whether any transition would occur at all. 

Figure [7] shows the evolution of the total entropy dur- 
ing a cross roll transition. It can be seen that the total 
entropy monotonically increases in time. It can also be 
seen that the change in the static part of the convective 
entropy and the change in the sub-system entropy are 
positive during the transition. The dissipation, which is 
the rate of change of the reservoir entropy, is proportional 
to the Nusselt number. Although the Nusselt number is 
higher for the final state than for the initial state, it can 
be seen from the inset that it does not increase mono- 
tonically during the transition. Since the proposition 
that the dissipation is maximised in the optimum non- 
equilibrium state implies that the dissipation increases 
during all stages of a spontaneous transition, the data in 
the inset provides further evidence against the maximum 
dissipation idea. 

Figure [5] shows the final wave numbers calculated from 
a series of cross roll transitions for different initial wave 
numbers at a Rayleigh number of 10,000. Since only cross 
roll transitions were permitted in the computations, it is 
possible that the calculated cross roll domain is larger 
than the measured one because unlike the calculations, in 
the experiments other transitions can supersede the cross 
roll transitions. The most likely final wave number for 
any one trial is the wave number that, out of all possible 
wave numbers la x , has the most power after a transition 
has occurred, a x = (27+ l)a x . This varies between trials, 
and it is the average of these that is plotted for each initial 
wave number. It can be seen that the final wave number 
depends upon the initial wave number. One aspect of 
this dependence is the existence of a region of stable ini- 
tial wave numbers for which no transition was observed 
(6 wave numbers spanning this region were tested, with 
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4-12 trials in each case). A second aspect is the sys- 
tematic increase in final wave number with decreasing 
initial wave number for large initial wave numbers. One 
can possibly make out the opposite trend for small initial 
wave numbers. This variation of the final wave number 
is statistically significant. It is possible that at least part 
of the scatter of the experimental data^i in Fig. [S] can 
be attributed to a similar dependence on the initial wave 
number. Also, the relatively small change in final wave 
number, as well as the opposite trend on either side of 
the stable region, are consistent with the experimental 
data£i in Pig. that appear to show no difference in the 
final wave number for systems that were in a small or in 
a large wave number initial state. 



Another example of this dependence of the final state 
on the initial state is the zig-zag transition. Although 
not explored here, it is observed experimentally^! that 
ideal straight rolls initially close to the low wave number 
neutrally stable boundary, aj, can undergo a spontaneous 
zig-zag transition to another ideal straight roll state, ori- 
ented at 45° to the initial rolls, with final wave number 
«f = 0,1^/2. Obviously then this is a clear example when, 
at a given Rayleigh number, the final state depends upon 
the initial state. Again the final state is determined by 
the thermodynamics of the transition itself rather than 
by any single time thermodynamic variational principle 
of the final state of ideal straight rolls. 



Figure [8] brings the focus to the transitions rather than 
the states. For a given Rayleigh number and initial wave 
number, distinct final states (i.e. distinct transitions) oc- 
cur with non- negligible probability (not shown). For ex- 
ample, in the case of 72. = 10, 000 and a y — 5.4, 4 dis- 
tinct transitions actually occurred in 9 trials, (a x = 3.4 
occurred 4 times, a x = 3.0 occurred 3 times, a x = 2.6 oc- 
curred once, and a x = 3.8 occurred once). The existence 
of distinct final states from which no further transitions 
occur signifies that patterns with a given wave number 
are locally stable and that there are barriers to further 
transitions, which is consistent with the experimental ob- 
servations. 



The data in Fig.[8]imply that at a given Rayleigh num- 
ber, it is less meaningful to speak of the average wave 
number for ideal straight roll convection than it is to 
speak of the average wave number following a transi- 
tion from a given steady state. This particular point 
was already made in connection with Fig. [5l where the 
distinction between the wave number resulting from a 
conduction-convection transition and from a cross roll 
transition was discussed. Even this is a severe simplifica- 
tion of the full convective transition phenomenon, since 
the final wave number of the cross roll transition depends 
upon the initial wave number. 



VIII. CONCLUSION 

1. The Second Law of Thermodynamics 

For an equilibrium system, the Second Law of Ther- 
modynamics provides the variational principle that de- 
termines the optimum state. The primary statement of 
the law is that the total entropy increases during a spon- 
taneous transition. The corollary of this is that the total 
entropy is maximised in the optimum state. (This is the 
same as minimising the free energy, which is minus the 
temperature times the total entropy)- 7 

The Second Law of Thermodynamics rests on two dis- 
tinct bases. First is quantitative evidence, originally 
experimental measurement, and, in more recent times, 
computational data. Second, is reason, namely Boltz- 
mann's identification of entropy with the logarithm of 
the molecular configurations that comprise a state. By 
linking entropy to probability, Boltzmann provided both 
an intuitive physical explanation of why entropy increases 
during spontaneous transitions, and also a mathematical 
prescription for calculating entropy and its evolution. 

Just as important as what the Second Law says is what 
it does not say. Nothing quantitative is said about time. 
Implicitly the law gives the direction of time but not its 
speed. Specifically, the law says nothing about the rate 
of entropy increase, the dissipation. 

There is a class of static systems, namely those that 
are hysteretic or metastable, that illuminate a specific 
aspect of the Second Law of Thermodynamics that is 
relevant to the discussion of heat flow that follows. Such 
systems include glasses and slowly relaxing substances, 
macromolecules, (e.g. the shape and conformation of pro- 
teins), and systems stuck beyond the usual phase tran- 
sition point (i.e. absent nucleation sites). These systems 
can be quite stable (i.e. they do not change macroscop- 
ically over experimental time scales) and in this sense 
they can quite reasonably be described as equilibrium 
systems. And yet, the current state of such systems can 
depend upon their past history. As far as the Second 
Law of Thermodynamics is concerned, it is quite true 
that the total entropy has increased during the evolution 
of such systems to their current state. But the entropy 
is not necessarily a maximum in the current state. One 
interpretation of such systems is that they are trapped 
in a local entropy maximum (free energy minimum) , and 
that there are barriers that prevent a transition to the 
state of global entropy maximum. 

There are two relevant lessons that can be drawn from 
this example. The first is the importance of both evi- 
dence and reason for the Second Law of Thermodynam- 
ics. If the law were based only upon evidence, then the 
existence of such hysteretic or metastable systems would 
appear to invalidate it, or at least the corollary that the 
optimum state is the state of maximum entropy. How- 
ever, because one has a reasonable physical interpreta- 
tion of the Second Law, one can instead identify these 
cases as exceptions to the rule, and interpret them in 
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terms of barriers that preclude transition to the globally 
optimum state. The second lesson from this example is 
that entropy as a variational principle can have practical 
limitations in determining the actual state of the system. 



2. Specific Conclusions for Heat Flow 

Turning now to the specific results of this paper, one 
can draw some definite conclusions for convective heat 
flow. The Principle of Maximum or Minimum Dissipa- 
tion was discussed in the introduction of the paper. This 
is the variational principle that some have postulated for 
non-equilibrium systems, namely that the optimum state 
is given by either a maximum or a minimum in the rate 
of entropy production. For the case of heat flow, the 
dissipation is the heat flux divided by the temperature 
gradient, which is essentially the Nusselt number. The re- 
sults in Fig.[5]for a spontaneous cross roll transition show 
that neither the measured 3 ^ nor the calculated final wave 
number correspond to the maximum Nusselt number. 
(The wave number of minimum Nusselt number would 
lie off the scale.) Similarly the calculated spontaneous 
conduction-convection transition yields a final state that 
does not correspond to an extremity of the Nusselt num- 
ber. The present results, as well as earlier results , 30 ! 34 
show that the observed convective patterns following a 
spontaneous transition do not correspond to either the 
maximum nor to the minimum heat flux. Hence the 
superficial conclusion from these quantitative observa- 
tions is that neither the maximum dissipation nor the 
minimum dissipation yield the optimum non-equilibrium 
state. 

It might be objected that one cannot draw this con- 
clusion solely from the data because, as in the case of 
metastable or hysteretic equilibrium states, there are bar- 
riers that prevent transitions: a globally optimum state 
might still exist but it is simply not achieved in the ex- 
periments or calculations. In other words, the violation 
of the Principles of Extreme Dissipation might only be a 
matter of practice rather than of principle. Continuing 
the objection, even if barriers reduce the utility of the 
Principle in this system, one or other of the two Princi- 
ples might still be valid, and it might be useful for other 
non-equilibrium systems. 

There are two counter arguments to this objection. 
The first is quantitative and is illustrated in the inset 
of Fig. [7] There it is shown that the Nusselt number 
(equivalently, the heat flux or the dissipation) evolves 
non-monotonically during a spontaneous cross-roll tran- 
sition. This rules out both Principles of Extreme Dissipa- 
tion: the Nusselt number neither always increases nor al- 
ways decreases during a spontaneous transition between 
convective states. Hence even if there were no barriers 
between different convective states, the optimum non- 
equilibrium state cannot correspond to an extremum of 
the Nusselt number. 

The second counter argument is that neither of the 



Principles of Extreme Dissipation is supported by rea- 
son. Unlike the Second Law of Thermodynamics, there 
is no molecular interpretation that provides a persuasive 
picture for maximal or minimal rates of entropy produc- 
tion. Hence there is no credible basis to argue that the 
results of these experiments and computations for con- 
vection are an exception to a general rule. 

Besides ruling out any Principle of Extreme Dissipa- 
tion for convective systems, the present calculations al- 
low one to draw another quantitative conclusion for heat 
convection, namely that the final state of a spontaneous 
transition depends upon the initial state. This was shown 
in Fig. [5J where different straight roll states resulted, 
depending upon whether the initial state was the con- 
ducting state, or whether it was an orthogonal cross-roll 
state, and in Fig. [FJ where it was shown that the final 
wave number for the cross roll transition varied with the 
initial wave number. A similar dependence is seen exper- 
imentally in the zig-zag transition.— These results imply 
that for heat convection a single time thermodynamic 
quantity (such as the heat flow, or the sub-system en- 
tropy, or the total system entropy) is practically insuffi- 
cient to determine the optimum state following a sponta- 
neous transition. The word 'practically' here recognises 
that it might be the barriers between convective states 
that give rise to the dependence on the initial state and 
so the insufficiency of a single time quantity might be 
one of practice rather than one of principle. (Just as 
the insufficiency of entropy for describing a metastable 
or hysteretic state is a limitation in practice that does 
not rule out entropy as an equilibrium principle.) 

In summary, the present quantitative calculations for 
heat convection lead to two specific conclusions. First, 
the Nusselt number (equivalently, the heat flux or the dis- 
sipation) does not change monotonically during sponta- 
neous transitions between convecting steady states. From 
this it follows that the Nusselt number cannot provide a 
variational principle for heat convection. And second, 
due to the presence of barriers signified by a dependence 
of the final state on the initial state, in practical terms 
there cannot be any single time variational principle for 
heat convection. 



3. General Conclusions for N on- Equilibrium Systems 

The behavior of the Nusselt number and its equivalence 
to the dissipation rules out any general principle for non- 
equilibrium systems that asserts that spontaneous tran- 
sitions between states correspond to a monotonic change 
in the dissipation. The corollary of this is that there 
can be no general Principle of Extreme Dissipation for 
determining the optimum non-equilibrium state. (Non- 
equilibrium state means both flux and structure.) The 
mathematical basis for this general conclusion is just an 
axiom of Aristotelian logic: the single counter example of 
heat flow in convecting systems disproves the general the- 
orem. The physical reason why there can be no principle 
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of extreme dissipation is outlined below. 

Beyond the dissipation, general conclusion can be 
drawn about transitions. The specific results for heat 
convection obtained here shifts the focus from non- 
equilibrium states to the transitions between them. This 
was the conclusion drawn from Figs [5] and [HI namely that 
the observed non-equilibrium state is conditional upon 
the initial state prior to the transition. This highlights 
the importance of the second entropy as the variational 
principle for non-equilibrium systems, since it is the two- 
time thermodynamic quantity that gives the probability 
of transitions. 

There are two reasons to believe that in general non- 
equilibrium systems are better characterised by their 
transitions than by their states. The first argument, 
which is no more than suggestive, is based on the ob- 
servation that in general a non-equilibrium state often 
means a steady pattern that is defined by the contrast 
between distinct regions of fluxes and structure. It seems 
reasonable to conclude that each region must represent 
a locally stable state, and there must be barriers inhibit- 
ing transformation from one pattern to another. For the 
same reasons as in heat convection, in practice such bar- 
riers negate the efficacy of single time thermodynamic 
quantities compared with the transition entropy. 

The second, more rigorous, reason is that the non- 
equilibrium systems of interest can generally be modeled 
as a thermodynamic gradient imposed on a sub-system 
by reservoirs, and it is the structure and flux of the sub- 
system that represents the non-equilibrium state being 
characterised. However, the thermodynamic gradient can 
also be considered as arising from a spontaneous fluctu- 
ation of the total system, with the consequent flux be- 
ing the regression of that fluctuation. This means that 
the current state of the sub-system is really part of the 
end state of a transition from the initial fluctuation of 
the total system that occurred some time in the past. 
In ranking two alternative non-equilibrium states of the 
sub-system given the applied thermodynamic gradient, 
it is not valid to compare their structural entropies be- 
cause one is not comparing two spontaneous fluctuations 
of the sub-system. Likewise, it is not valid to rank them 
according to their total entropies, again because the total 
entropy now is due not to a fluctuation now, but rather 
to a prior fluctuation of the total system. (If total en- 
tropy was the correct ordinal function, then the steady 
state with the greatest dissipation would always be the 
preferred state because it would have the greatest total 



entropy after sufficiently long times. Hence the sentence 
immediately preceding these parenthetical remarks pro- 
vides the physical reason for ruling out the Principle of 
Maximum Dissipation in general.) Instead of these one- 
time thermodynamic functions (the sub-system entropy, 
the total entropy, or the dissipation) , one has to compare 
the two states conditioned on the fact that the fluctuation 
of the total system has already been regressing for some 
time. This is why two-time rather than one-time thermo- 
dynamic quantities provide the relevant variational prin- 
ciple for characterising the non-equilibrium state of the 
sub-system. 

The regression of the total system obeys the Second 
Law of Thermodynamics, namely that the total entropy 
increases over time. Hence the total dissipation is posi- 
tive for any non-equilibrium state. (For a steady state of 
the sub-system, the total dissipation equals the dissipa- 
tion of the reservoirs.) In analysing the possibility of a 
transition from one steady state to another, the Second 
Law of Thermodynamics demands only that the total 
dissipation must continue to be positive. It does not say 
that the dissipation has to increase. Even if the entropy 
of the sub-system for the final state is lower than that for 
the initial state, the transition is permitted provided that 
the decrease in sub-system entropy is smaller in magni- 
tude than the integral of the reservoir dissipation over 
the time interval of the transition. (In such cases, this 
sets an upper bound on the speed of the transition.) 

The second entropy is essentially the logarithm of the 
number of molecular configurations that give the transi- 
tion. Its exponential gives the probability of a transition 
from one non-equilibrium state to another. Hence the 
second entropy is the two-time thermodynamic quantity 
that characterises non-equilibrium states and patterns. 

In the present paper the second entropy appeared in 
two, indirect, ways. First, the hydrodynamic equations 
are equivalent to maximising the second entropy with re- 
spect to the fluxes, whilst accounting for the material 
conservation laws and equilibrium equation of state (see 
Refs MM and Ch. 5 of Ref. GJ). Second, the accu- 
mulation of trial transitions between steady converting 
states is equivalent to mapping out the second entropy 
conditioned on the initial state. These two applications 
of the second entropy demonstrate its utility. The spe- 
cific results obtained here for heat convection support 
the general conclusion that the two-time second entropy 
(or its generalisations for non-Markov systems)^ is the 
variational principle for non-equilibrium systems. 
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